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PREFACE 



The Board of Education of the Los Angeles Unified School District voted in 
mid-1975 to contract with an outside group to study gains in 6th grade reading 
achievement in selected elementary schools with predominantl^y minority popula- 
tions. The impetus for t he study was the installation of the School Preferred Reading 
Program in 1972. Jn January 1976 the board awarded a contract to Rand, calling 
for an analysis of the program's effects on reading progress for Black and Mexican 
American students, .» . 
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SUMMARY 



Increasing students' reading achievement, particularly among minority stu- 
dents, has long been a central concern of the Los Angeles Unified School District. 
To further that goal, the LAUSD instituted its School Preferred Reading Program 
in 1972. In 1975, it contracted with The Rand Corporation to conduct 'the present 
^tuciyT^'hose purpose is fo'idenfif^^tlie school~an3"classroom policies and other 
factors that have been most successful in raising the reading scores of inner-city 
children. 

We selected a sample of 20 elementary schools for analysis. All displayed large 
or consistent gainsidfl percentile points on national norms) for the 6th grade on the 
CTBS reading examination between 1972 and 1975, had predominantly minority- 
group student bodies (about half were mostly Mexican American, the other half 
mostly Black), were located in low-income neighborhoods, and had 1975 enrollments 
of at least 400' students: " ' 

All principals and reading specialists present in 1.976 were personally inter- 
viewed, and a questionnaire was administ(?red to 81 of 83 teachers who taught 6th 
grade in these schools in 1974* and 197.5. The purpose was to gather information on 
school leadership, reading program content and implementation, classroom atmos- 
phere, and te^'^her attribute's. 

Background and demographic information, and reading test scores (from grades 
3 through 6), were recorded for individual members of the 6th grade classes of 1974 
and 1975 in 32 district junior high schools. The students' 6th grade classroom and 
school experiences, as identified in the elementary school data collection, were 
linked to their test scores and background information to construct a longitudinal 
file. Students for whom it proved possible to collect such data were found to be amply 
representative of students who graduated from the 20 schools in the sample in 1974 
and 1975. Our analyses were conducted on these longitudinal files, not on compari- 
sons of scores of successive bth grade classes in a given school — the jnethod the 
district typically uses to measure reading progress. The latter can easily be distorted 
by changes in student body characteristics from one year to the next. Although the 
schools in our sample gained appreciably, in reading achievement between 1974 and 
"1975, the average 1975 6th grader in our sample declined slightly on national norms 
from his or her 5th grade rank. 

The tests used by the district were found to be reliable, as technically 'defined, 
according to standards of internal consistency and parallel form. High reliability 
was found not only for the sample as a whole but for individual schools. 

The validity of a few of the reading gains registered in sample 6th grade class- 
rooms was thrown into doubt by interview reports of test exposure. These reports 
were matched by patterns of unusually high gains for large fractions of students in 
these same classrooms (a total of six out of 78). The data from these classrooms were 
excluded from the analysis. In four additional classrooms, gains were as large and 
as concentrated, but we received no field reports of excessive test preparation. We 
performed our analysis with these four classrooms included, and then repeated it 
after deleting them, to measure the sensitivity of our results to varying judgments 
as* to the extent of test exposure. 
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Background factors (such as socioeconomic status, health, ethnicity, and attend- 
ance) and reading test scores in earlier grades, were found to account for the largest 
part of the variation in 6th grade reading scores for the children in our sample. For 
both Black and Mexican American children, however, other variables reflec?ting 
.particdai^5chDol- and Ttai5SroWi~experiences" also"hIi^^ -influence. In 

contrast to some previous research, we found that the school, the teacher, and 
combinations of schoo^and teacher did make a difference in explaining measured 
reading proficiency. We also found that principals in both ethnic subsamples were 
able, with surprising accuracv. to identify and rank teachers i nJ,hei_iigc_bilQisjbyJ±Le^ 
teachers' ability to bring about reading progress (as measured by data on individual 
student gains, which were not available to the principals wheii they assessed the 
teachers). 

In analysing specific factors associated with observed gains in reading perfor- 
mance, we obtained strong results only fur the sample of Black students. For them, 
the following factors were sfgnificant: 

• Teacher training in the use of a variety of materials keyed to individual 
student needs 

• Teachers who felt efficacious 

• Maintenance of orderly classrooms 

• High levels of parent-teacher contact 

• "^Teacher flexibility in modifying and adapting instructional approaches ^ 

• Frequent informal consultations among teachers in implementing reading 
programs 

The first three factors were significant even when our analysis excluded all class- 
rooms in which the validity of test outcomes was uncertain. Confidence in the 
findings with respect to the last three- factors was lessened, however, when we 
adopted this maximally skeptical procedure. 

We also conducted a supplementary study — largely subjective, because of limit- 
ed resources— of community involvement in the schools. We concluded that, in 
Black neighborhoods, the more vigorous were the schools' efforts to involve parents 
and community in school decisionmaking, the better did 6th grade students in those 
schools fare in reading attainment. 

Factors not associated statistically with the reading gains of Black children 
included specific reading program or system^ readin'g strategy (e.g., phonics versus 
comprehension), and such teacher attributes as ethnicity, experience, and type of 
education. .., 

Our inability to identify specific factors associated with the reading gain&^of 
Mexican American students — which in fact were alrnost identical overall to the 
gains registered by Black students — was probably due to failure to include or accu- 
rately measure some key variables.' For example, we had no data on variations in, 
English fluency across the sample of Mexican American children. 

Our findings support the continuation of the LAUSD's School Preferred Reading 
Program, which features school autonomy and teacher flexibility. Because princi- 
pals seem able to identify effective practices, because teachers need the freedom to 
adapt and the training for individualization, and because no prefabricated reading 
system or strategy can provide a '*quick fix" to the complex problem of reading 
instruction, a good measure of decisionmaking authority at the local school level 
seems warranted. 
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; Chapter 1 
INTRODUCTION 



The impetus lor thj^ study arose as the Los Angeles Unified School District 
(LAUSDi'was about to complete its third year under the School Preferred Reading 
Program. The program concentrated on elementary students who were scoring at 
the 25th percentile or lower on standar^dized reading tests, it featured determination 
of* goals and approaches by individual schools, and it set minimum, quantitative 
objectives for reading gains hi the 3d and 6th grade levels. The first year of the 
program. 1.972-73, emphasized diagnosis and program 'desigii; the following two 
years incorporated the devised reforms into ongoing school operations. 

The purpose qf the study was to identify those aspects of school reading pro- 
grams that were associated with substantial and consistent gains in standardized 
reading test scores among mirioritv children. 

The terms of the contract award to Rand specified that the outcomes in reading 
achievement were to be- gauged in terms of scores on standardized tests. Many 
analysts of the educational process — including some members of the Rand study 
team — have expressed doubts about the accuracy of such tests as indicators of 
students' educational progress, particularly for students from minority backgrounds. 
Beqause test scores are recognized and accepted many others, however, we felt 
it [inportant and worthwhile to try to' discove r .vhich classroom approaches and 
whicji^'school pojicies were associated with inc/CLises in such scores. 

As part of this effort we sought to determine whether the observed gains were 
valid and reliable, to identify school and program characteristics that accounted for 
the valid gafns, and to provide advice on the applicability of successful programs to 
other' schools and to future school operations. 
- Rand conceived this- task as the identification of school and district policies that 
hold the most promise for improving reading achieve'ment in minority schools. 
Therefore, the study does not focus on the teacher-student interactions thaPare 
oflen the basis for/'process" analyses of education, such as how directive teachers 
are, how cl^ar their -presentations are, how. frequently they ask questions,'or how 
they reward students for good work. Instead, our analysis concentrates on 'how 
policy variables— for example, the content of schools' reading programs, the ways 
the programs are implemented, and support, from principals— are associated with 
gains and losses in achievement test scores. These kinds of variables are only a part 
of what matters in the schooling process, but we believe they represent the bulk of 
the factors that can be directly measured and influenced bypeople involved in school 
policy decisions: administrators,, feacher groups, and parents. Consequently, our 
policy analysis seeks to identify those reading programs and school and classroom 
environmental factors that can be most readily altered to improve students' reading 
skills. 



RESEARCH APPROACH 

Wo became convinced early in the study that the criterion of improvement must 
be the.gains in reading achievement over time for a ^iven ^rouj) of atudenta as they 
progress from grade to grade. Year-to-year gains at a fixed ^rade level, the criterion 
often used, can be misleading: successive cohorts of students in that grade may differ 
sharply— in previous reading achievement and socioeconomic status, for example — 
and hence distort the true picture of gains, particularly in areas with high inter- 
school mobility. 

To determine which reading approach or other educational factors are r^jiably 
related to reading gains, we considered a large number of hypothetical factors3\and 
assessed each one's likely influence on reading achievement. For us to do so. the 
schools in our sample had to vary in reading outcomes. Fortunately, they did. 
Otherwise— if all the schools had scored about the same — there would be no way of , 
judging the relative success of the different approaches to reading adopted by in- 
dividual schools and teachers. 



CONDUCT OF THE STUDY 

Our first task was to select the 20 elementary schools that would constitute our 
sample. This selection was performed in conjunction with LAUSDstaffand with the 
assistance of community groups. The schools chosen had to demonstrate: substantial . 
or C()nsistent test score gains across 6th grade classes between Spring 1972 and Fall 

enrollment of at least 400 students, with minority children making up at least ^ 
80 percent of the student body by_ Fall 1975; a balanced distribution among schools 
with predominantly Black and predominantly Mexican American enrollments; and 
a ranking in the lowest 200 (out of 436 total) on Title 1 criteria (which a based 
essentially on the socioeconomic status of students). Appendix A describes those 
criteria in more detail, and lists th(i names ofthe 20 schools and their characteristics 
as compared with other schools in the system. 

Thus, as would be expected, our sample schools have a higher percentage of 
minority students,^ larger enrollments, lower socioeconomic rankings, and larger 
gains in reading test scores in successive 6th grade classes than do the aggregate of 
elementary schools. in l^AUSD. They started much low'^r thah all other schools on 
6th grade reading scores (measured in. percentiles on national norms) in 1972 and 
had registered much larger percentage gains by 1975. These schools also had a 
starting point slightly lower than the average 80 percent minority school in the 
district; their gains by 1975 were proportionately larger than those in other minori- 
ty schools; 

Test score data on individual students in the 6th grade classes of 1974 and 1975 
from the 20 saniple schools, and other information on the students' ethnic and 
family background, health problems, and elementary school attendance patterns, 
were collected in the 32 junior high schools where the student cumulative records 

' A HuljHtrtntiiil Kiiin whh ili'fiiicd jih Jin inrrcuHC oCjii Icjih^ If) {wn'fnlilc points fjii ihc nnt ionnl noniiH 
(or iIh* Mi'Of'aw-I liJI (V)fn|)n»!irMiHiv<« T<'st oC H/isic Skills (|w)rin i\ conslstf'iit ^iiin riuMinl Hint no 
Hirifjif Vfiir's inrrcnsr' (»xccc(Jc(J iwo'tliirds oCthc totjil ^ain, 

•'•Of Mlack and Mexican Aincricnn Htudcnts. thnt i.s. The .s.jnpic hcIiooIs liavc a lnw(»r proixirtion of 
A.Hinn arifl Native Aincricnfi studcntH Ifiari docH the syHtcrn ifA -t whole 
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are now located. Thus we were able to retrieve inlbrniation on reading scores Ibr 
^rradesa Ihrou^di 5 lor these same students, making it possible to study their reading, 
pro^M-ess over time, which we believed necessary Ibr reasons discussed earlier. No 
student nanujs have been retained in our files. Students were traced to their tradi- 
tional receivin^^ junior hi^^hs and also to schools they attended through the Permits 
with Transportation pro^^ram. 

We were able to collect lon^Mtudinal data (i.(v. data Ibr individual students over 
a four-year period) for 74 percent of the ^^raduatin^^ class of 1974 and percent of 
the uraduatin^^ class of 1975. For none of the 20 schools did we find data on le.ss than 
68 percent of the students. By c{)niparin^ the mean raw score ((TBS-Q2) Ibr nil 
Ifsl-takers in the 20 schools with the same (i^aire for all students fbr whom cumula- 
tive records were located, we were able to ascertiiin that uur complete data sample 
was highly representative of the student p()[)ulation of test-takers in e;ich of the 20 
schools. Data collection procedures, response I'lites.imd the possibility of sample bias 
are di.scussed in detail in App. A. 

Inlbrmation {)n school atmosphere, mana^^'ment and administration, teacher 
civaracleristics. and approaches lo reading instruction were collected by means of 
personal interviews or self-administered cjuestionnaires amon^ the faculty and ad- 
ministrators of the 20 elenientiiry .schools. In three of the schools, intensive case 
studies were conducted that permitted us to characterize differences in readin^^ 
prot^rams and lo investigate how school settings alfect readin^^ instruction. This 
information contributed to the construction of questionnaires adminstered in fdl the 
schools to teachers, principals, and reading coordinators, or their equivalents. The 
survey data were t-hen transformed into quantitative factors designed to describe 
teacher characteristics, classroohi approaches to readinK^ implementation methods, 
classroom atmosphere, emphasis on test-tiikin^ skills, trainin^^ received, teacher's 
use of resources, and parent contiiets. At the school level we attempted to measure 
principals' sui)p()rt and implementation lictivities. use of management systems, and 
the accuracy with which principals iire able to identify faculty who are eflective 
reading teachers. 

Chapter 2 uses the data collected to perform an analysis of the reliability and 
validity of observed reading scores, our lirst analytical task. Chapter 2 also presents 
the model we employed to examine the reliability of test scores and conceptuali'/,e 
valid K'iiins. and we comment on the possible ellects of'test emphasis" in some 
classrooms on the validity of test score results. 

Chapter '3 treats the influence of school, classroom, and pro^^rammatic facfors 
on readin^^ achievement, the subject of our second analytic task. We identify factors 
that our analysis indicates did in fact inlluence readin^^ ach.ievement, such as stu- 
dent body composition, program and implementation factors at the school and class- 
room level, and the activities of teachers and parents. Quantitative findin^^s on the 
influence of each factor on reading achievement are discussed. 

Chapter 4 summarizes several of the positive fact{)rs found in our statistical 
analysis and illustrates what they look like in practice, the intent hein^^o lend aid 
to principals and teachers seekin^^ to improve their own schools' readin^^ pro^^rams. 

Chapter 5 covers the results of (jur interviews with parent and community ^rpoup 
rnenibers, our lln:d analytic task. It treats our assessment of the de^nce to which 
parents and comnuinity representatives were involved in school alfairs. their roles 
in school decisionmakin|,^ :\nd their possible relationship to readin^^ [)ruKn-ess. 
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Chapter 6 presents our conclusions and recommendations. We summarize our 
findings and comment on theinapplicability to future programs in the 20 schools and 
to other schools in the LAUSD. Since we analyzed data f ropi a nonrandom sample 
of schools* the generalizations from our findings arenot «nam6//,'iio«s/y applicable 
to the population from which this sample was deriyed; it is,at^east possible that the 
schools in our sample share some characteristics that systematically differentiate 
them from all other LAUSD schools or even from the population of'LAUSD minority 
schools. Since we, the LAUSD. and the public are interested in the generalization 
'of lessons learned in this study to other schools and other times, the reader is 
cautioned that our policy recommendations contain a substantial judgmental com- 
ponent. Our judgments are based on our experience with other schools and other 
school systems, the knowledge of* practitioners, participants, and observers we 
talked with, our understanding of'current district praictices, and our acquaintance 
with the process of implementing educational innovations. 
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Chapter 2 

RELIABILITY AND VALIDITY OF READING GAINS 



All 20 schools show varyin^^ gains in 6th grade reading achievement from 1972 
to 1975, some oj* them, dramatic. While our ultimate goal is to identify school, 
classroom, and reading program (actors that may be responsible for these gains, 
several, preliminary issues must be settled before this substantive analysis can 
proceed. First we must establish whether the tests used by the district are relicible 
for these predominantly minority schools, as compared with the reliability stan- 
dards reported by the test publishers. Second, we must determine whether the gains 
are valicl: that is to say, whether they reflect real gains in achievement by students 
who have experienced the reading programs 'in these schools. Finally, if any gains 
are found to be unreliable ordnValid, we must develop a procedure for identifying 
reliable and valid gains to be used in the subsequent investigation of school and 
classroom factors. 

In addressing these issues, we will use data from both the student cumulative 
records and the teacher surveys. Data available from, student cumulative records 
include results for several different reading achievement tests and subtests over the 
three years since the reading program began, some of which were administered 
concurrently. These data can be used to explore a number of reliability and validity 
problems, includiiig the true gains fbr groups of students over time. In addition, the 
teacher surveys included an "open-ended question concerning the teachers' own 
opinions about the validity of gains shown by their schools. Their answers were 
useful forjudging that validity. 



RELIABILITY 

All standardized test scores contain some amount of unsysftematic, random error 
that is unrelated to a student's true ability. Test reliability assesses the degree of 
random error found in a given test instrument; it is measured by reliability coeffi- 
cients whose values range on a .scale from 0 to 1. Generally speaking, a test is 
considered reliable if its reliability coefficients equal or exceed 0.90. A test with a 
reliability much below 0.90 contains a fairly high degree of random error,'and may 
be deemed unsuitable fbr investigating ihe causes of reading gains. 

To be sure, the standardized tests selected by the LAUSD and the State of 
California haye demonstrable reliability coefiicients exceeding 0.90, and in fact the 
reading tests most widely used in the district— the Comprehensive Test of BTisic 
Skills (CTBS), forms R, Q, and S— all have reliabilities of 0.95 or above. However, 
the basis fbr these published reliabilities consists of national norming studies that 
•use predominantly white or Anglo populations; separate coefiicients for minority 
populations are seldom available, (liven the frequent concern that tests fbr Anglo 
populations may not be reliable fbr minority populations, it is prudent to establish 
reliability levels fbr our specific sample of predominantly Black and Mexican Ameri- 
can schools. 

5 



6 



Using data derived from student cumulative records, we can investigi te:two 
specific types of reliability. First, internal consistency reliability can be estaolished 
by using the correlation between the verbal and jomprehension subtests available 
from the CTBS form Q2 administered to district 6th -^ders in the Sprii.g of 1975. 
Second, we have a rare opportunity to. assess parallel form reliability for the CTBS 
(brm Q2 and form S2, both of which were administered to all district schools during 
the Spring of 1975. Both types of reliability can be' calculated for t^uch school in our 
sample and compared with similar coefficients based on norming data published by 
the test developers (see CTBS. 1970. 1974). 

Internal Consistency Reliability 

Internal consistency reliability is usually estimated by using ^all individual test 
items and applying'a formula such as KR-20 (Guilford. 1954). By such a procedure 
the CTBS publisher reports reliabilities of 0.95 for the Q2 and R2 reading tests and 
0.96 for the S2. Unfortunately, individual item scores are not available for the 
district data, so we must adopt another method. Since the CTBS reading test- is 
composed of two subtests, vocabulary, and reading comprehension, both of whose 
scores 'are'available from the cumulative record, an alternative method is to apply 
the Spearman-Brown formula to the subtest correlation (Guilford, 1954). The Spear- 
man-Brown formula gives- the reliability for a test as p ~ 2r/(l + r), where r is the 
correlation between any two subtest scores whose sum constitutes the total test 
score. The subtest correlation reported by the test publisher is 0.82 for the CTBS Q2 
given to 6th graders, which yields a Spearman-Brown reliability of O.SO for the total 
test ' . 

Table 2.1 lists the subtest correlations for each of the 20 schools; correlation for 
the total sample is 0.80 with an associated reliability of 0.89, which' is nearly identi- 
cal to the test norm. Further, the correlations and reliabilities for each school cluster 
fairly tightly around this value. Given a population correlation of 0.82, correlations 
computed from sample sizes around 80 (a conservative average for these schools) 
yields a 90 percent confidence interval between 0.75 and 0.87, which means that we 
■ would expect' 90 percent of the sample values to fall in this Vanf?e over repeated 
samplings. Indeed, we see that the correlations for all but two schools, or 90 percenf 
of the sample, fall within this range. The two exceptitins are Eastman with acorrela- 
tion of 0.74, and Ascot with a correlatiomof 0.71. In general, the levels of internal 
consistency reliability are high and compare favorably with the results from test 
norms. 

Parallel Form Reliability 

Another method for estimating reliability relies on Che existence of parallel 
forms, which in this case means reading tests .that cover identical subject areas but 
whose individual item content differs. The correlation between two parallel forms 
is the reliability of either form. Forms' R and Q.. of the CTBS reading test were 
designed as parallel forms. Form S is a newer version and is not^strictly a parallel 
form for Q cr R, since it covers some slightly different content. Nonetheless, test 
norms show a correlation of 0.93 between S and Q reading at 6th grade, which 
actually exceeds the parallel form correlation of 0.89 between R and Q. 

In the Spring of 1975 all district 6th grades were given both the Q2 and the S2 
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, Table 2,1 

Internal Consistency Reliabilitiks for 6th Graders 
Taking the CTBS Q2 in 1975 



Ci)rri»!alii)n Between 
Vc)eal)ulary ami 
Ci)mpielu*nsion Suljtests 



Keliabilitv* 



(N) 



Alta Loma 

Anjieles Mesa 

A SCO I 

Dacotah 

Kastman 

Koril 

! larrison 

Hillside 

Manhattan 

Miller 

1 iSlh Stret-t 
n2th StrecM 
Pact)ima 
Ki)semunt 
Kowan 
McKinley 
Sierra Pa'rk 
10th Street 
•28lh Street 
Vermont 

Total sample 

Test norms 



O.SO 
0.77 
0.71 
0.S2 
0.7^1 
0.75 
O.St^ 
0.78 
0.7(^ 
O.SG 
0.S7 
0.S7 
0.7S 
O.Sl 
0.79 
0.75 
0.S3 
0.80 
O.Si) 
0.83 

rO.SO 

0.82 



0.87 

0.8:5 

0.90 

0.85 

0.8 ti 

0.92 

0.87 

0.8 () 

0.92 

0.9:5 

0.9:3 

0.88 

0.90 

0.88 

0.80 . 

0.91 
■ /0^^9 
''^:0.92 

0.91 

0.89 
' 0.90^> 



(80) 
(75)- 
(85) 
(()7) 
(110) 
((i2) 
(52) 

(78) 
(7-n 
(0-2) 
(50K 

( U)f>) 
/(87) 
(28) 
(:59) 

(129) 
((il) 
(8(i) 
( (M ) 

(1110) 



* From the Spearman-Brown fornnila = 2r/i 1+r), where r is the 
subtest cort'oUUion. 

^^The internal consistency coefficiefit jiiven by tin- publisher, hasetl 
on all inilividual lest items, is 0.95 (usinu 20). 



^reading tests, the scores for which are available in the cumulative records. Table 2.2 
shows the correlation between the Q2 and S2 reading scores for students who took 
both tests (which includes about 90 percent of our total sample). For the sample as 
a whole the Q2-S2 correlation is 0.90, which compares favorably with the norm value 
of 0.93. Again, the reliabiiiiies for individual schools are high, although a number 
of schools fall outside the 90 percent confidence , interval of 0.89 to 0.95 (assuming 
an average sample size of about 65 students). Nonetheless, all of these correlations 
but one (Manhattan's 0.82) establish a high degree pf school-level reliability for both 
the S2 and Q2 versions of the CTBS reading tests. 

Summary 

These results offer solid evidence that the reading tests used by the district in 
these minority schools meet the reliability standards determined by the'test publish- 
er in its national norming studies. Not only are the reliabilities high, nearing or 
exceeding 0.90, but two different methods of determining reliability yield nearly 



\6 



8 

T«bie2.2 

Parallel Form Reliability /or 6th Graders 
Taking the CTBS Q2 and S2 Reading Test; 
. IN 1975 





Correlation 






. Between 






Q2 find S2 




School 


Reading Scores 


(N) 


Alia Loma 


o.ss 


(03) ., 


An^i'los Mt'sa ' 


O.St) 


(72) 


A SCO I 


0.91 


(7S) 


Dacolah 


0.S9 


(<>-!) 




O.SS 


(110) 


Foi-d 


0.92 


(r);n 


Harrison 


0,90 


(TiO) 


iIillsi(U> 


0,92 


(^11) 


Manhattan 


0.82 


(72) 


MilhM- 


0,S6 


(70) 


1 ISth Streot 




(a) 


1 12th Strt'ot 


0.91 


(19) 


Pacoima 


0.9:5 


(97) 


Rosumont 


■ 0,S9 


(SC) 


Ilowaii 


0,9-1 


(20) 


McKinley 


V0,92 


(20) 


SiLM'ra Park 


0,90 


(12G) 


1 0th Street 


0,S7 


(nS) •■ 


'2Sth Street . 


O.SS . 


(SO) 


Vermont 


0,92 




Total Si.inple 


0,90 


(1272) 


Test norms 


0,911 





NOTK: -Tht^S and Q are not strictly i)aralle!. but 
th(» norm correlation tor S and Q resembles the 
paralUd form correlation for R and 

''Data Tor form S is not av;Ulable in oin'J'ik\ 



identical results: Even more important, high reliabilities are also shown on a school- 
by-school basis. ' . 

In concluding that the tests are reliable, howeverp^Ave ar^e not yet Claiming that 
the test results in these 20 schools reflect true reading gains. Reliability coefficients 
assess random, unsystematic errors or inaccuracies, but not systematic biases. In 
Other words, reliability coefficients reflect the consistency of results, not necessarily 
their truthfulness. The presence or degree of systematic bias is determined by a 
validity analysis. 



VALIDITY OF GAINS 

While there are many aspects of test validity, we are concerned here with only 
one; namely, whether the changes in successive 6th grade reading test scores reflect 
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real ^ains in reading achievement by the students in these schools. We do not 
attempt to assess the validity of* the standardized tests themselves: such investiga- 
tion is outside the scope of'our study ^Rather, we (issi/nie that the CTBS reading test, 
properly adniinistered and scored, is a vah'd measure of* English reading skills for 
the purpose ot comparing one minority student (or school I with another. 

Even with this assumption, however, there are still two sources of potential 
invalidity for reading gains. First, although it is true that all schools in our san?ple 
show increasing 6th grade scores from 1972 to 1975. these apparent increases derive 
from comparing different groups of students— that is. different 6th grades from one 
year to the next. Such gains owe partly to differences in the ability and composition 
of the successive 6th grade groups. For example, the 1975 6th graders at a school 
may have .scored higher than the 1974 6th graders merely because they were higher- 
achieving students to start with. To assess true change, we must compare^the perfor- 
mance of the same group of students between, say. 1974 and 1975 as they pa.ssed 
through the 5th and 6th grades.' , ^ 

A second possible source of bias is test exposure, it is a fundamental assumption 
of standardized achievement testing that students are not exposed beforehand to the 
test or to specific test content. The justifiable desire to familiarize minority children" 
with standardized testing procedures has led to special test preparation exercises, 
including use of "practice" tests similar in format— but not content— to the CTBS. 
Such exercises are both legitimate and oflen necessary. However, any exposure of 
students to the official test or to a word list taken from the specific CTBS form wo;ild 
invalidate all or part of the test results. Any resulting gains \yould be real in the 
sense that scores would change, and they might also be reliable (ifexposure occur:-ed 
for both parts of a test or for both parallel forms). But such gains would be invalid 
since in all likelihood they would consist mostly of temporary changes induced by 
knowledge of the correct answers rather than an increase in reading skills. When 
test exposure occurs, the gains in reading scores are likely to be both sudden and 
very large. Since we observed such 'g^iins at certain schools, .we undertook a separate 
analysis to assess this potential source of invalidity on -a classroonvby-classfoom 
"basis. 

Change in Reading Achievement 

The first issue our validity analysis must settle is whether gains in 6th grade 
reading scores reflectfimproved readjng ability. To do so we must compare test r^'ores 
for a given cohort of students as it progresses through the elementary-grades— for 
example, their scores from grades 3 through 6 for the 6th grade clas^ af 1976, 
retrieved from the cumulative record. Students from the 6th grade class of 1975 who 
remained in a Title I school from 1972 to 1975 had a 6th grade Q2 reading score in 
the Sp/ing of 1975, a 5th grade R2 score in 1974, a 4th grade R2 score in 1973, and 
a 3d grade score from the Cooperative Primary test in 1972. Since the R and Q are 
■parallel forms normed in the same year, we can use them to assess changes in the 
same cohort or group of students from grade 4 to 6. It is more difficult to assess 
change from grade 3 because the Cooperative Primary is not parallel to the CTBS 
series, so test diflerences may not be valid indications of change. 

/ Before turning to an empirical analysis of reading gains, we must raise a practi- 
cal problem regarding the meaning of change on a standardized reading test such 
as the CTBS. Basically, there are two ways to assess change. First, gains in reading 
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knowledge can be assessed by comparing the vjiw scores from one year to another 
on the same form (or equivalent forms) of a given test. Obviously, such raw gain 
scores have meaning only for a particlar test» since tests v£lry in numbers of ques- 
tions» time instructions, content, and so Forth. But from a policy standpoint, a more 
important iiqiitation is :that raw gains' do not tell us whether a program affects 
reading ability over and above what would be expected from typical students in any 
school. The reason is that nearly all schoolchildren show raw gains in reading from 
year to year, regardless of their school or program. Consequently, we must use some 
type ..of standardized score to determine whether a special program has affected 
minority reading skills beyond what would be expected of average children without 
the program. 

The second way to assess change is to make cbm{?arisons between standardized 
scores such as percentiles. A percentile score— the measure used most widely by the 
district and the state— relates a student's.standing to a national no^;m. For example, 
a student scoring at the 50th percentile has a, raw score in the middle of the distribu- 
tion, with half the studejits in the national norming sample scoring higher and half 
scoring lower. To remain at the 50th percentile in succeeding grades, a student has 
to gain about 10 raw score points a year, since the national norming sample for the 
CTBS shows this amount of gain in successive grade levels. One difficulty in inter- 
preting percentile scores, then, is that equal percentile scores mask absolute gains 
•:in reading skills. A further problem w^ith percentile scores for this study is that the 
national norm is determined by a predominantly Anglo population, and it is general- 
ly known that, nationally, minority populations score lower on standardized tests 
than Anglo populations. It might be fairly argued that the minority students in 
these schools should be compared with a national norm for minorities unfortunate- 
ly, separate norms for Anglo and minority populations are seldom^available from 
test publishers. . - v 

To counteract these various difficulties we present our change analysis in both 
raw score and percentile score forms. - ' 

Total Sample Change. Table 2.3 shows the change in reading achievement 
from grade 3 to 6 for our sample of 1975 6th graders. The change for the total cohort 
appears in the top halfbfthe table, using all students with at least one reported score 
in a given grade level, while the bottom half shows the change for a longitudinal 
sample of those students who have reported test scores in all four grades. 

The essential point to be seen from Table 2.3 is that while all the schools in our 
sample show succ(;\ssive gains in . average 6th grade percentile scores from 1972 to 
1975, the 'same cohort of students shows a slightly declining trend in percentile 
scores from grade 4 to 6. In other woVds, for the sample as a whole, successive 6th 
grade percentile changes should not be used to conclude that a given group of 
students actually improved in reading achievement percentiles over this period. 

Table 2.3 also illustrates the problem of comparing. the Cooperative Primary 
with the CTBS. ..Note tha^an^increase from the 23d percentile in the 3d grade to the 
31st percentile in the 4th grade is contradicted by the slight declining trend from 
the 4th to the 6th grade. Since it iriakes little sense that the reading program should 
have a positive effect in the first ye^r^ut not in later years, it is more likely that 
Cooperative Primary .scores are not directly comparable to the CTBS series. 

We enipluu^izc thai the (h.clininfi percentiles in Tabic 2.3 do not mean that 
atudentH are not learninf: to read better. On the contrary, changes in the raw score 
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Table 2.3 



COHOUT ANIl LON(iITUI)lNAi;CHANOKS tN RkAIJINC, 
SCORKS FOR THK TOT.AI, SaMPI.K 





197'i: " 


197 a: 


197!: 


I97ri: 




(Jrade .'> 


C.radt' '\ 


(Irade ") 


Cira(l<' 


Cohort 


Coop Primary 


(TBS \V2'< 


' CTHS U2 


CTBS Q2 


Cohort of all 










1 975 (>th uradcrs 










Povco nlilr 


•i;r; 


:ir; 


'2S';' 




Raw nu'an'^ 


= •29 J) 


29.7 






( N 




. •(r.!S7) 


(1207) 


( irio2) 


•i^ont<it lulinal panel 










Peri'i'iltih' 








29'V 


•J Raw riiean 


129.7 


;u).;i 


:i9.9 


5'). 7 


(N) . 




( 


7'M)) 





.''Uaw mean excludes Miudiallan. Rosemont. and Sii'rra F^u'k" which iiave the 
Q2 in 197:j— hut the percentile includes all the schools. 



^The maximum reading score is iSf). 



means from 4th to 6th grade— 9 points from grade 4 to 5.. and 16 points from grade 
5 to 6— show clearly that students are advancing in absolute terms. But since 
students in the national norming sample show slightly higher gains over these grade 
levels on the same tests, the result is a slightly declining percentile trend for our 
sample. The national norms show a gain of 12 raw points from grade 4 to 5 (for 
students at the 33d percentile in 4th grade) and a gain of Id points from 5th grade 
R2 to 6th grade Q2 (for students at the 30th percentile on the 5th grade R2). 

Not all students in the 1975 6th'grade cohort took all the tests since 3d grade; 
that is the reason the number of cases differs from year to year in the third row of 
Table 2.3. Since we want to compare the same group of students over time, the 
bottom two rows of Table 2.3 sTiow test results from a "longitudinal panel" of those 
students who have taken all the tests. Even though this panel is much smaller than 
the 1975 cohort (759 versus 1502) there is no significant bias. The panel nas slightly 
higher ability than the entire cohort— about 2 percentile points— but the trend of 
decreasing percentile scores remains nearly identical. 

School-by-School Changes. Table 2.4 shows the school-by-school changes in 
reading achievement from grade 4 to 6. We do not identify individual schqols here 
because we pledged confidentiality to survey and interview respondents, and some 
of the information in this section is sensitive^ We have scrambled the order of the 
schools (so their names are not in alphabetical orderl and have arbitrarily assigned 
letters in place of names. 

Although the 20 schools were chosen because of percentile gains in successive 
6th grade reading scores, the change analysis reveals that, for most schools, the 1975 
6th grade class actually shows a decline in average percentile scores relative to its 
position in the 4th grade. In many cases the decline is^slight; fairly large declines- 
have occurred for schools F, G, H, and K. Six schools show positive gains, but some 
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Table.2.4 

Changk'in Rkadinc; Achikvkmknt by School 
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A 


: \ r, ■ 
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;■) 7 


( 9"' ) 


B 


212 


IS 


2:i 


+ 1 


2.1 


:U) 


'i2 


I y 
(10) 


C 


:iO 


."52 


2 ') • 




29 


1 2 


o.'J 


M "M 
1 I - J 


D 


'2\.\ 


2.') 


20 




'11 




■19 


\ 5 5 1 


K 


29 


22 




+;u) 


2S 




70 


M 'M 
I 1 — J 




r)0 


-1 1 


:^2 ■ 


"IS 


12 


•IS 


"19 


(29): 


c; 


.1.') , 


2i) 


' 2:5 


12 


V;}2 


10 


52 


- ((U)) 


II 


12 


• M 




1 2 




■1 1 




i .lU ) 


I 


'M) 


2.') 


22 


s 


29 


• > 1 


^ ",1 


(IS) 


J 


:m 




;i2 


■) 


:^2 




fjS 


(Hi) 


K 


2S 


20 


15 


1:5 


2S 


:vi 


i:j 


(;5:n 


L 


2.') 


IS 


:n 


+() 


2(i 


;u) 




(5^1 ) 


M 


•M) 


2{) 


2() V 


1 


29 




51 


(22) 


N 
0 


2i) 


:u) ■ 


2S ' 


1 


2S . 


• I 1 


5(; 


(.'U)) 


:{1 


(1)) 


2;') 


- 1) 


;57 


(i>) 


52 


(55) 


Q • 


1:5 


:js 




■< 


i5V 


■17 


01 


(70) 


•20 


i(j 


;r2 


+ :i ' 


" 2S 


IS ■ 


5S 


\i 


M) 


10 ' 


ri2 


+ 1 ;] • 


-12 


■IS 


07 


(00) 


s 


:V2 


:J2 


;}() 


. ■) 


;{o' 


■12 


57 




'V . 


21) 


:n 


:}() 


. +1 


27 


12 


57 


, (12) 




in) 




20 


1 


;U) 


10 


50 





''S{*h()ols A. (), iiiul K liiivi' fort^i C^2 scori's in urado -l: all oUum's .;iri» I\2. 
5th ui'Jidi' si'oi'i-s availahli'. 



gains arc slight and the pattern is not consie^ieat over the three years. Large gains 
are shown by school Q from grade 4 to; d, while schools E, L, and R show large gains 
from grade 5 to 6. Clearly, comparing different groups of students in the same grade 
from one year to another doe? not constitute an assessment of the actual change or 
improvement experienced by the same group of students over time. 

Another factor that may explain part of the difference between Table 2.4 scores 
and successive 6th grade scores is that the district used median percentile scores, 
while we assigned a percentile ranking to the raw mean for a given school. The 
difliculty with median percentile scores is they do not reflect changes in scores below 
or abovt^ the median value. Our analysis of the distribution of raw scores on a 
school-by-school basis showed that, indeed, there were many shifls of raw scores 
(eithev.upward or downward) from one year to another thai occurred entirely below 
(and sometimes entirely above) th6 median for both years. As a consequence the 
median might remain constant from year toj^'oar, or even increase slightly, in spite 
of serious declines in scores below the median. U is our conclusion that a comparison 
of raw score means, when converted to percentiles, more accurately summarizes the 
total ghango over time than do median percentile scores. , 

Table 2.4 also shows the changes in. raw score means for each school. We empha- 
size that every school shows an increase in absolute reading scores in both years, 
meaning that reading skills are improving in all schools in our sample. However, 
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since the average student (at these levels! who takes the CTBS shows a i^ain of 12 
raw points from ^n-ade 4 to 5 and 18 raw points from ^n-ade 5 to 6, most schools show 
net declines in their-percentile scores. 

While the chan^^e analysis shows declines in achievement percentiles for most 
schools, it is still possible that successive 6th gv^de chan^^^s are ^ood relative indica- 
tors of the iiiost eflVctivc^or least erfeelive schools. This can be tested by comparing 
the ranking of schools according to sui•ce^;^;ivo 6th grade, percentile changes (see App. 
Ai with a ranking based on Table 2.4. The rank order correlation is 0.65 for all 20 
schools, which confirms a fairly good— although by no means perfect — relationship 
between sue^ '^s^.-f 6th grade change and actual longitudinal change. But when we 
exclude thr < ;chools whose scores might be invalid for reasons givt>n in the* next 
section, tht- rank order correlation drops to 0.51. Clearly, although 6th grade dilier- 
ences from year to year are somewhat intlicative of actual improvement, this validi- 
ty correlation is not high tmough to warrant substitution'of successive 6th grade 
change for measures of actual change. In particular, for our analysis of the effects 
of reading program factors, we wilj want to use actual longitudinal changes in 
reading ai-hievcMiKMU as our main criterion. 

Test Exposure 

We found that a nun^ber of classrooms sl^owed unusually large gains in average 
reading levels from grade 5 to 6. In an analysis of individual schools and classrooms, 
we found that some students — and sometimes an entire cli^LSsroom— gained over 50 
percentile points. Such changes are possible for individual, students over an ex-^ 
tended period, but it is exceedingly rare for special reading programs to cause such 
large shifts for large numbers of students in a one-year period. Therefore, when the 
distribution of these unusual gains lends to cluster in certain schools, or, more 
imporc'uit, in certain classrooms, the possibility of prior test exposure— "teaching 
the test" — must be explored. 

Most teachers familiar with standardized testing procedures recognize that test 
exposure invalidates test-scores. Sometimes, however, the incentives to engage in 
overzealous test preparation may be so strong as to lead to test exposure. A number 
of teachers surveyed said they felt administration or principal pressure to raise test 
scores at their school. Moreover, many teachers are sensitive to the problems of 
measuring the ability level of minority-children on standardized tests. When asked 
whether test scores accurately reflected their students' ability level, 20 out 81.of our 
sample teachers reported that scores presented a worse picture than really existed 
because of problems in test-taking. As a result of these concerns, most schools have 
initiated Sfiecial tests or programs for improving children's effectiveness in taking 
standardized tests, such fis creating a test awareness center in the classroom, in- 
structing students in test-taking skills, providing practice with multiplechoice tests, 
and orienting one's own tests to expose children to the mechanics of standardized 
tests. All these activities are entirely legitin"iate, appropriate, and oflen necessary. 

But an emphasis on test-preparation that extends to drilling children on actual 
test questions, teaching the vocabulary words on the test, or exposing children to test 
materials prior to test day introduces a serious bia.s and invalidates test score,'.. Of 
course, not all test exposure is intentional; it may occur inadvertently if a teacl :»r's 
vocabulary list 'for drill chances to have a high concentration of words from the 
various CTBS reading test forms. Unfortunately, we have evidence of intentional 
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test exposure in a few of'our classrooms. Although it applies to only a small minority 
of the teachers in the study, their classrooms must be eliminated f rom the sample 
before we can proceed with an analysis of factors associated with valid reading gains. 

Our evidence on test exposure takes two forms. First, and most critical, three 
respondents at two schools stated that reading gains at their scools were invalid 
because of test exposure. These two schools — and especially the six classrooms in- 
volved—showed unusually high proportions of students gaining more than 30 per- 
centile points or so in the one year between the 5th and 6th grades. . 

Second, several other schools with high average gains showed a concentration 
and patterning of changes similar to those where exposure was claimed directly. 
These schools are characterized by an uneven distribution of change both within and 
between classrooms, frequently yielding a bimodal distribution wherein one group 
shows little or no change and another group shows extreme change. Although these 
changes cannot be definitely attributed to test exposure, the fact that exposure 
occurred in some hi^-gaining classrooms prompts us to raise questions about the 
validity of reading gains for all classrooms showing a high concentration of unusual- 
ly high-gaining students. 

Table 2.5 shows the uneven distribution and concentration of high-gaining stu- 
dents. A high-gainer is defined as a student gaining' more than 3 deciles (or about 
30 percentile points) in reading between grades 5 and 6. At the school level we note 
that the 143 high-gaining'students are concentrated in five schools — B, E, L, R, and 
T, with percentages of 27, 73, 54, 36, and 17, respectively. The remaining schools 
have between 0 and 6 percent of these high-gainers. More'important, the right-hanfl 
portion of the table shows an uneven distribution of these students within the 
schools. In schools B And T, for example, which have lower proportions of high- 
gainers than the other three, most are concentrated within 3 of the 8 classrooms. 
Altogether, 10 out of 78 classrooms have more than 30 percent of their students 
showing gains exceeding 3 deciles during the 6th grade. 

Of those 10 classrooms, 6 were in schools where claims of test exposure were 
documented in the teacher survey. lPor the remaining 4 classrooms we have no 
definitive proof of test exposure, although we ^did gather certain other indirect 
evidence in addition to the observed concentration of unusually high-gainers. FiVst, 
for three out of the four teachers who were present in the district during the 
previous school year, we found that none of their 6th grade students gained more 
than 30 percentile points during the 1973-74 school year; in fact, two classes shov/ed 
a net decline in. achievement percentiles (the other showed a slight increase of 3^ 
percentile points). Thus, their large classroom gains in 1974-75 v/ere inconsistent 
with their classroom gains the year before. Second, in one of these classrooms we 
found that two-thirds of the high-gainers had vocabulary gains exceeding 50 percen- 
tile points with only a few showing comparable gains in comprehension. It is possi- 
ble, then, that their 6th grade vocabulary gains may be spurious, possibly because 
of test preparation practice on. a word list taken in part from CTBS reading ^tests. 
Finally, three of these classrooms sent students to junior highs that administered 
7th grade tests in the spring of 1976. Unfortunately, since tests are given only to 
randomly selected students in each class, only 3 of the 23 high gainmg students had 
7th grade reading test scores. But all 3 of these students showed pi i^ ipitous drops 
in reading percentiles from grade 6 to 7 that matched their dramatic rise from grade ^ 
5 to 6 (209f to 79% t.o 7%; 29% to 72% to 21%; and 11% to 69^'; to 199. i. The only' 
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Table 2.5 
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credible explanation for such extraordinary shifts for these three students is that 
test exposure inflated (and hence invalidated) their 6th grade scores. 

We conclude, therefore, that 6 of these 10 classrooms with high proportions of 
unusuajly high-gaining students almost certainly H^ave invalid gains due to test 
exposure. In another 4 classrooms, the statistical patterns and inconsistency over 
three school years raise ^the distinct possibility of test exposure, although we have 
no conclusive proof that it occurred. -'While the proportion of classrooms where 
^exposure may have occurred is small,* r^nping from 8 percent to at most 13, our 
/analysis must nonetheless take into account these possible sources of invalicl gains. 

PROCEDURES FOR HANDLING INVALID GAINS 

A rneaningful assessment of characteristics of effective reading programs re- 
quires a reliable and valid criterion ifbr reading gains. While we have shown that 
the reliability 'of the CTBS reading test is adequate, two problems hamper a correc- 
tion for the possibility of invalid gains in . 6th grade reading scores: (1) In 4 of the 
10 classrooms in which unusually large gains occurred, we have no teacher reports 
of test exposure to confirrn the statistical evidence. (2) Even teachers whose overzeal- , 
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ous preparation exercises led to tesi exposure may ako have used highly effective 
approaches to reading instruction. That is, the reading test results n;ay be a mixture 
ofexposure effects and educational effects. In fact, our analysis ol'the characteristics 
ofthose teachers whose students registered unusually large gains reveals that some 
of the teachers also scored high on various classroom variables we measured. It is 
possible, then,' that correction for invalid gains tends to exclude unusually good 
teachers as well. 

Faced with this dilemma, we have followed a procedure designed to reveal the 
power of'school and classroom factors as a function ofone's belief'about the true role 
of test exposure in producing measured gains. The procedure is as follows. We first 
measure the efie^'t of'the various factors under >the assumption that all gains were 
valid. Next, we exclude the results for the six classrooms where exposure reportedly 
occurred, Lastly,' \ve exclude results for alJxi'O classrooms including the four" with 
unusually large and intonsi^stent gains/'/^s pointed out in Chap. 3, the power of the 
school and classroom (actors in e^f,^>WTning measured gains declines as more groups 
of students are deleted. T])e:*r^li5er's acceptance of our list of successful educational 
practi.r's must therefore depend on the reader's belief'about tHe extent of test 
t^poMire and how many of these classrooms produced invalid gains. 
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Chapter 3 . ^ ^ ^ 

INFLUENCE OF SCHOOL AND CLASSROOM FACTORS ON 
READING ACHIEVEMENT > • ' - 

School policy decisions that attempt to improve students' rending achievement 
arvbasedon policymakers' beliefs about how reading can be most effectively taught. 
This chapter analyzes the experiences ofout- 20 sam^^le schools to idc^itify the most 
successful school and classroom- factors in raising students' reading levels. It is 
intended to contribute to policymakers' information regarding .effective instruc- 
«tional policies. ' , . ■ 

* .,We attempt to answer two questions: First, what decision levels are.most closely 
associated "with increases in. students' reaaing scores — district level, schoof level, or 
classroom level? This might be called "the management question." since if district 
management policies are to be ellective. staff members who actually have "policy 
leverage" (in that their decisions can affect reading achievement) should also have 
the responsibility and the authority to use it. Our analysis of the management 
question-concludes that much of a child's reading achievement depends on the 
particular school and classroom he or she attends. 

The second question can be called the "school allocation question.'-' because it 
deals with ho\v each school aljocates its resources and staff energies among the n'lany 
policies that maySnfluence reading achievement. This question' can be stated as 
follows: What combinations of curriculum, program implementation strategies, and 
classroom atmosphere will promote the greatest reading achievement? It is appar- 
ent that principals and teachers in the dlst t\c\ are'already considering this question.' 
Our analysis of the school allocation question is intended to- provide additional 
information that principals arid their staff members \vill find useful in the difficult 
choices they have to make. We have also cinalyzedTfTeTpw^on of whether principals 
have enough. accurate information about instruction in. eac^tl's^l^^srooni to identif 
strengths and weaknesses in their schools'^'instructional programs?"" 7 

We conducted parallel analyses for Black and M<jxican Americari students, 
because of the possibility that school and classroom experiences affect^these two 
groups in different ways. By undertaking parallel studies of the effect of school and 
classroom factors on the reading achievement of; Black and^. Mexican American 
students, we talie into accounfthe likelihood that the effectiveTiess of school factors 
depends on the specific needs of students, and on the schools' ability to deal with 
these needs. • ' ^ 

To correct for the problems with the validity of the district's test scr>res raised 
by test exposure, we checked our results by comparing them for different sets of* 
assumptions about the scores' validity. A few of our results are sensitive to these 
assumptions, and the effect of differing validity assumptions will be discussed. 
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THE MANAGEMENT QUESTION: WHICH POLICIES AFFECT 
READING ACHIEVEMENT? 

The question oCwhether district policies, school-level decisions, approaches used 
by individual teachers, or various otho; factors determine the reading achievement 
-of inner-city, children is obviously of great importance to policyniakers. Since the 
district will doubtlessly wish to allocate authority and responsibility commensurate 
with staff capacities to influence reading outcomes, vve'begin this chapter by examin- 
ing whether reading results in our 20 schools were due to policies at the district, 
school, or classroom levels, or to individual and -'background" factors beyond the 
reach of school policies. 

The analysis was conducted for slightly more than one thousand students who 
were in the 1974-75 6th grade class in our 20 schools. (See App. A.) We analyzed the 
increase in reading achievement tha^ occurred over the 6th grade year, using data 
from those students who took reading tests at the end of the 5th grade and again 
at the end of the 6th, who were enrolled in regular classrooms, and for whom 6th- 
grade attendance data were available. We studied this group for two reasons. First, 
it pjDSsible to collect data for them (primarily test scores, student background 
mSsiH^s, and classroonV attributes). Second, the 1974-75 school year was the second 
operational year of the School Preferred Reading Program and therefore offered a 
fairer test of it^ influence on reading than did the previous year. 

As Chap. 2 amply demonstrates, students' reading achievement in our sample 
varies widely. Overall reading ability increased at all 20 schools — substantially at 
some schools, very little^ at others (see Table 2.4). It can be inferred that school 
district policies produced an environment in which substantial increases in reading 
achievement were possible, but those policies produced resulfe that were fair from 
uniform— not a surprising outcome for a large school district. ' This wide diversity 
in reading achievement suggests that one needs to examine differences among, 
schools and classrooms to answer the management question. 

Our stu'dy considered three additional jjarts of the management question: 

1. How important to a student's achievement is-the particular school he or 
she attended, compared with other schools? 

2. How important is the particular classroom to which he or she was assigned, 
' compared with other classrooms? 

3. How important is the student's particular classroom^ within a given school, 
compared with other classrooms in that school?^ 

Each of these questions considers one particular way in which the child's school 
might affect his or her achievement. It is apparent that^any and all school effects 

' It was technically impossible for u.s to ilctermine the influence of district- wide policies on reading' 
achievement. This is because we did not comp)are Los An^^eles with other school district.s ou that basis. 
The amount ofdiversity ^^•e found, however, clearly confutes the hypothesis thai district p{)licies uniform- 
ly dominated readinf( outcomes. District policie.s may be a ncce.s.s-an' condition for reading ^ains, but they 
are not sulfjcient to explain the diverse ^ci\ni^ that were recorded. 

' These questions wereexii .ried by testing a "baseline" hypothesis that a child's school and classroom 
do not explain differences in learning, and comparing if with the hypothesis that they have unique and 
identifiable effects on learning. (Table 3.1 presents result.s of these comparisons for Black and Mexican 
American children.! Thi.s analytical technique was first used to analyze students' school achievement in 
the research of Eric Hanushek (1970) and Richard J. Murnane (1975). We have relied on their work in 
the desi;^n and presentation of this section of our analysis. 



20 



are ct)ntin^^ent on the capabilities and problems that each child brin^^s to school: 
prior\nowled'^a^ and skills, ^^ood or poor healthV'stron^^ or weak motivation and 
interest, and the wide variety of family, peer, and community experiences that 
shape a child's life and orientation to school. The question we ask is: Given the 
limited time and techniques that the schools can use to help children learn, to what 
extent^^is children's reading achievement attributable to school and classroom fac- 
tors, rather than to the important nonschool factors that have shaped students' 
educational performance before they even enter the classroonV? 

We know that policies aflecting reading instruction vary among schools, and 
that within schools, teachers have different approaches to reading instruction. If 
particular school and classroom policies und approaches have varying effectiveness, 
the 6th grade reading scores of students with identical initial achievement levels 
and background characteristics, but ivith differvnt sc/ioo/ and c/assToor?! {.experiences, 
will differ in proportion to the influence of those, experiences. The multivariate 
analysis we conducted permitted us lo mer^sure the strength of school and classroom 
factors vvhile holding constant the effects of a student's sex, attendance at school, 
family background, ethnicity, and 5th grade rei^ding achievement. (See Table 3,1. 
The table displays statistfcal tests of the size of the effects of .school and classroom 
factors on reading, holdmg constant the effects of a student's background and initial 
achievement.) 

As mentioned, we conducted parallel analyses for Black and Mexican American 
children. (All of the analyses reported in this chapter were likewise disaggregated 
for these two ethnic groups.) We did so because the structure of the analytic model 
may differ for children of different ethnicities. For example, we found that the two 
groups differed in the amount of variation in 6th grade, reading achievement that 
was attributable to factors other than 6th grade'school and cbssroom inputs. Such 
individual and background variables accounted for 57 percent of the' variation for 
Black children and 64 percent for Mexican American children (see Table 3.1). 

Such differences necessarily imply that school and classroom factors variously 
--affect students with different backgrounds. In this situation (which may be due to 
. uneven measurement accuracyjfbr different groups, as well as actual learning differ-* 
ences) separate analysis was th^ most prudent course.'* 

^We fbtind that both'school and classroom factors significantly affected the read- 
ing achievement of both Black elnd Mexican American 6th graders. This finding was 
not .sensitive to whether some, all, or none of the classrooms where t pst exposure was 

. ^ Discussion of the effoct ofcthnic difrercnces on model specification for education production function 
studies such as this on^ may be found in Hanushek tl970) and Boardman (1975). 

The educational literature on the learning patterns of Mexican American students discusses several 
issues relevant to our fmdin^;s l-tire. Fir^t of all. the language abilities of Spanish-speaking children vary 
all along ■ he continuum of Spanish-English bilingualism and various specific cultural and subcultural 
backgrounds. (P. A. Zirkel. "Spanish-Sp^'aking Students and Stardardi/cd Tests.': UrUin Review, Vol. 5. 
No. 6. June 1972. pp. 32-4Q.I It therefortj may be necessary to disaggregate a Mexican American sajriple 
such asfours into smaller subgroups based onEnglish language ability, language spokJ^n jnthe-honrt'TeUr^ 
before it is possible to determine precisejy what facto r^airyribute-to- it nprovedl-eading achievement for 

these students. --1— s • 

A second point is^Lhat-oufdependent variable is based on tests that mea.su re reading achievement 
_jn-English'.'7iorreading achievement peij sc. A number of researchers have administered standardized 
reading achievemo^nt tests in both the original English forms and a Spanish translation to Spanish- 
speaking .students rvpd have found that the students scored higher on the Spanish version. This difference 
was strongest on sul^csts dealing with word meaning. (See ibid, for a summary of the.se studies.) Other 
researchers contend t\iat standard- English to standard-Spanish translations are not enough to jjroduce 
equivalent achievement tests. One must also be' aware of cultural boundaries that restrict meaning 
within a language. > '. 
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Table 3.1 

Hypothesis Tksts for School and "Classroom Effects 



Bhick Childron 



Mi'xic;in-Amrric';Hi 
Children 



(Ilj) 



p <0.0()001 



(II.,) 



(1:1. 



CO'.OUOOl 



' ( 1 \ ' 
1) <o.()()q;j 

•••(:n.5()S) = ^-'^' 
1) <o.oO()();3 



riio school a child attends is sig- 
nificant 1\' related lo achievement. 
(C'()m|)arison ol' K(js, 1 and 2) 

The elassroom to which a child is " 
assitined is si^niTicantly related id 
;M'hievenient. 

( C'()mi)arison of Hcjs. 1 anil 3) 

(H.^) The particular classroom within a 
pai'Vicular school to which a child 
^ is assiiined is simiificanlly related - 
to achievement. 
(Comparison of Eqs. 2 and 3) 

Prnbabilily values (p values) show the p.-obabilit y of incorrectly reject iiiii the null hypothesis that 
n J . or 11.^ is false, respectively, for I he samples of Black and Mexican .American children. 



IS. 1 111) 
i) <0.()001 



= .1. i:5 



' (2().riii)) 

!)<{). 001 



I'or Black 
Children 



R" for Mexican 
.■\nierican Children 



H(| nation 1. Rei^ression ol' ()th tirade score 
(m ^""^ih tirade score, sex. attendance, health ■ 
problems, family status, father's occupation, 
mother's occupatif)n. a^e. and whether addi- 
tional services were received under remedial 
readiim-.or iiifted program. 

K({ualion 2. Same as 1-. addinii dichoi- 
omoiis variabiles fox school attended b\' 
" each child. 

■iujuat ion :L Same as Kcj. 1 . addinii'dichol- 
onuHis variables for classroom attended b\' 
each child. 



0.61 



o.(sr) 



0.71 



0.(>7 



0.71 



.\OTK: Classrooms with fewer, than five Black or. Mexican .American children I'or whom complete 
(lata were available havj' been excluded from the analysis of that ethnic urouj). 



suspected were excluded. Growth in reading achievement depended on the school 
and classroom to which the child_was_assigned:-Stated'difrerently, if one wants to 
predjcLa-child'^-achievem^^^ at the end ofa school year, and one already knows the 
child's achievement level at the beginning of the year and has data on the child's 
background, it is still extremely important' to know which school and classroom the 
'child 'attended. We may infer that the reason for these significant school and class- 
room effects is that different "inputs" — school policies and classroom experiences — 
were received by children, depending on the schools and classrooms they were 
enrolled in. We'may also infer that these different policies and^xperiences are very 
important in determining each child's reading achievement, even afler taking ac- 
count of the many strong nonschool factors that obviously affect student's learning. 
This finding confutes the conclusion of several cross-sectional studies, including the 
Coleman Report, that school differences are only slightly related to achievement 
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once background variables have been taken into account, (See Mosteller and Moyni- 
•han, 1972. pp. 15-16. 19-22.) ' 

The answer to the mana^^ement question, then, seems to be that both individual 
schools and individual classrooms are afiectin^^ students* readini^^ achievement lev- 
els. Certain schools and classrooms in our sample produce students whose readin^^ 
achievement is higher than that of'students elsewhere who^started with similar 5th 
grade scores and backgrounds. This finding is consistent with the district s policy of 
goal-setting for reading at the individual school level, and with granting substantial 
responsibility, authority, and somej;esources to schools as they work to carry out 
their programs. Because schools iii the district are clearly diverse, it makes se:nse 
to permit them substantial autonomy in managing.their affairs; this policy is consis- 
tent with our findings on the a6/7ify of- schools and teachers to pursue policies that 
produce reading gains for their students.' 

Such diversity points up the impossibility of formulating aj.'quick fix" policy to 
promote equal readin^^ gains in all of the districts classrooms. (Our analysis of the' 
factors that produced improved reading achievement also suggests that no massive 
f)rograms or single strategies can raise reading scores all at once.) However, it may 
be possible to improve reading on .a schbol-by-school and classroom-by-classroom 
basis. ' 

The finding that the classroom to whrcn a child is assigned is a significant 
predictor of his or her progress during the school year permits an analysis of in- 
dividual teachers' contributions to students' learning gains. (If there had turned out 
to be no differences among classrooms with respect to students' gains, then it would 
not be possible to compare teachers' classroom reading activities to see whicJ] are 
most ef{*ective. as we shall do in the next section.) Our findings regarding the man- 
agement question, then, are that classroom outcomes are diverse and that classroom 
policies are .important contributions to reading achievement. The next section dis- 
cusses the nature and magnitude of these contributions. 



THE SCHOOL ALLOCATION QUESTION: HOW SHOULD, 
RESOURCES AND ENERGIES BE ALLOCATED? 

The success of the reading program critically depends upon discovering how to 
use the limited supply of school resoui-ces and'staff energies in a school to the 
greatest positive effect. Since principals and school staff members must constantly 
choose among many policies for enhancing reading achievement, we examined the 
relationshipof reading to a number of such policies. We focused on school "inputs" — 
the things that may affect reading growth-rrthat are actually under the control of 
the individual school, its teachers, and its community. V/e will discuss four such 
categories ofVeading inputs: 

' U \HV hud found that a child's school and classroom did not contribute to flctcrmlninK his or her 
readinji achievement, we would have concluded that there was no liasis for allocating the responsibility 
and authority for reading programs to the .schools. The fact that our finding' i.i.that .schools and classrooms 
d<J matter is con.sistent with allocating responsibility to the schoolsj hut // is rn)/ saljicivtit rrUlrtin' that 
this shoiiUI hi' (/o/ic. This is bocause we could not. investigate the effects, ifany. of vtiryin^^ the district's 
policies re^ardinK school authority and responsibility, since these pr)licies did not vary in our sample. In 
piirticular. we did not consider the effects of p()licies that could hold individual .schools accountable for 
.students' ^'ains'. if the schools wer(» to be ^Mven additional authority over their pro^^ranis. 
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• The teacher ci^^r/6u^es that shape the instri^tional process, 

• The c/assroom ^ettin^ in which reading is taught, 

• The curricular and instructional meihods used, and 

• The implementation .of* pi ograms for reading instruction. 

We conducted our analysis for slightly less than 400 Black students who were 
6th graders in 1974-75. We analyzed the increase in reading achievement that 
■ occurred during the 6th grade, using data on students who took reading tests at the 
end of the 5th and again at the end of the 6th grade, and who were enrolled in 
classrooms whose teachers completed a lengthy questionnaire that probed ap- 
proaches to reading instruction, attitudes^ and other attributes. The questionnaires 
allow us to.examine in detail which classroom factors produced reading gains; our 
results depend dii*^ctly on the cooperation of»81 teachers who took the time to 
answer our questions. (Two teachers did not complete the questionnaire. Because we 
lacked information about their classroom practices, it was necessary to exclude their 
.students from our analysis.) 

We conducted equally extensive analyses for Mexican American students, but 
were unable to uncover statistically significant relationships between their achieve- 
ment and the school inputs we measured. Since we know that school and classroom 
differences are important determinants of their reading achievement, we conclude 
that we were unable to discover what policies account for their learning. This may 
be due to poor measurement^ erroneous model specification, or insufficient informa- 
tion (perhaps on students' English fluency). 

The analysis considered the effects of a large number of school and classroom 
variables, while statistically controlling for each child's starting point (the 5th grade 
score), attendance, any significant health problems, and the child's age, sex, and 
family background. To correct for validity problems raised by test exposure, we 
excluded students in the six classrooms where our field research indicated that test 
exposure almost certainly occurred. (A discussion of the sensitivity of our results to 
this correction is presented beiow.) 

The school and classroom variables that we measured reflect four kinds of 
educational ''inputs" to student reading achievement: teacher attributes, the class- 
room setting, instructional methods, and the implementation of the reading pro- 
gram. - ' — 

We investigated the effects of variables related to each of these factors on 6th 
grade reading achievement, after controlling for the effects of prior achievement and 
student background. Since prior achievement and student background obviously- 

/ - ' ■ ■ ^\ 

^ The influence of various groups of school and classroom factors on students' reading achievement 

wa.s estimated using a multiple regression analysis. The dependent variable in the regression-equation 
was a student's 6th grade reading score: independent variables were the student's initial achievement 
(5t^ grade score), control variables (the student's attendance, sex. age. health, family background, and 
/the supplementary nonclassroom services received), and the school and classroom factors. The existence 
of substantial multicollinearity (i.e., complex patterns of correlations among independent variables) in 
the data led us to evaluate carefully which of our measured variables reflected the same underlying 
conceptual variables, to identify representative'measures of these underlying phenomena, and. sometimes 
to create new measures by combining responses to two questionnaire items (by multiplication or by linear 
combination). These efforts were guided by our categorization^ of school inputs into teacher attributes, 
classroom setting, instructional methods, and program implementation. We attempted to select meaning- 
ful and representative variables from categories, within each of which we anticipated considerable 
multicollinearity. When we encountered high collinearity between variables in different categories, we 
investigated the theoretical and empirical '.reasons for the collinearity and based our decision on those 
reasons. 
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account lor most of'the variation in school achievement isee App. B), we are interest- 
ed in the incremental contribution of school and classroom inputs to students' 
reading gains. 

We no%v turn to a discussion of the effects that we found to be significant con- 
tributors to reading achievement, beyond the effects of prior achievement and stu- 
dent background. Table 3.2 presents the statistical relationships between reading 
achievement and, the school inputs we identified as important.'' (A detailed descrip- 
tion of the variables that were entered into the multiple regression analysis can be 
found in App. C.) 

Teacher Attributes 

We analyzed two groups of teacher attributes: background characteristics and 
predispositions. We collected data on several background characteristics: the teach- 
er's race and ethnicity, college attended, undergraduate major,- whether any gradu- 
ate'training was received, amount of college instruction in reading, and teaching 
experience. We found no evidence of a relationship between any of these character- 
istics and students' reading achievement. Three explanations are possible. First, 
teachers' decisions about reading instruction, and their teaching skills, may be 
unrelated to background characteristics. Second, It is possible that a teacher's back- 
ground influences reading, but in an interactive fashion; for example, a teacher's 
undergraduate major in English might raise reading achievement only if the teach- 
er used literature and creative writing as part of the curriculum. Since we did not 
analyze any of the possible interactive effects of teacher background, we could not 
detect any such influences, even if they existed. Third, we know that teacher char- 
acteristics come in clusters; for example, many of the teachers who graduated from 
California State University at Los Angeles also majored in academic subjects, rather 
than in education. As a result of this clustering, it is not possible statistically to 
identify separate effects of the different characteristics,, evfen if those effects exist. 
(There may well be effects of teacher background. chat-acteristics on student out- 
comes that we did not measure — for example; students' seU-concept. We restricted 
our analysis to the influence of school factors on reading achievement.) 

We also measured one aspect of teachers' ipdividual attitudes 'toward teaching 
in minority schools: their sense of efficacy in dealing w^ith minority students. 

Our measure of teachers' feelings of classroom efficacy is based on two ques- 
tions."^ One asked whether the teacher felt that 'Vhen it comes right down to it, a 
teacher really can't do much (because) most of a student's motivation and perfor- 
mance depends on his or her home environment." The other asked whether the 
teacher thought that "ifl try really hard, I can get through to even the most difficult 
or unmotivated students." Responses to these questions were combined intg a single 
measure of efficacy— the extent to which the teacher believes he or she has the 
capacity to produce an effect on the learning of students. The more 'efficacious the 
teachers felt, the more their students advanced in reading achievement. This mea- 

Table 3.2 presents roKres.sion coefllcients and t-statistic.^. Re^irtwion c-DcMicii'nts measure thi' in- 
cren.se in the dependent variable (6th ^jrade score, measured on a lOO-point testi produced by a one-unit 
increase in ecich independent variab!" (the school inputs). The t-statistics measure statistical si^jnifici'nce. 
which we have coded with asterisks. 

' The standard discus^sion ofefrrcacy. on which we based our instruments; is J. B. Rotter (U)66). 
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Table 3.2 

Factors Producing Improved Reading for Buack Children 



I'Slat. Moan S.D. 



TKAC'HKK ArrRlBUTES 

St'nso of Int ricacy 

CLASSROOM SCTTING 

Disruptions 
• Numl)or of parent visits 

PltOGRAM CONTENT 

Variety o)' materials, with amount 
uainini^ (linear coml)ination ) 

IMPLEMENTATION STRATEGIES 

Teacher adaptation of program 
Toachor-tu-leachcr consultations 

o 

R^ = .695 

Unconstrained R" = 
N = 356 



1.75 

0.1)5; 



0.05 



OJ 1 
0.(50 



51** 17.1 ().0 



;j 2 1 ** * 2.2 1 2 
1.72** :U).n 30.9 



1.81** 2.S 2.1 



1.39* 19,8 9.0 

1.11* 5.0 1.0 



NOTE: Table based on re^re.s.sion analysis otVOth ^radc CTBS-Q2 raw reading 
score on 5th ^rade CTBS-R2 raw reading .score sex, attendance, health problems, 
family status, father's occupation, mother's occupatitjn, a^e, whether additional 
services wore received under remedial reading or gifted programs, and ihc variables 
(lisi)layed above. Uncon.strained R- is based oh the ecjuation -with background 
variables only, excluding those displayed above. 

Statistical confidence levels'for t-statistics: . ' 

*'^)<0.10 
**p<0.05 . ' . 

***p<0,Ol 



sure was strongly and significantly related to increases in reading. Obviously, teach- 
ers' sense of efficacy is only one part of the morale and commitment to teaching that 
we presume is a major influence on learning. Our finding that efficacy affects 
achievement demonstrates the importance of these predispositional factors for effec- 
tive teaching. 

. The data do not enable us to determine whether it is possible to raise teachers' 
feelings of classroom efficacy by providing more training, support, or supervision for 
those who wish it. It is possible that an improvement in teachers' morale and 
commitment could be produced by school policies that support teachers and help 
them solve their classroom problems, and ttiat their sense of efficacy might improve 
as 'a result. (Another possibility is that the teachers with lower feelings of efficacy 
are factually describing a. problem in the \yay they teach that is not subject to 
improvement without^ for example, a change in the kind^of school or classroom to 
"which they are aissigned^ or some other substantial change in the nature of their 
work.). 
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TeacFiers can afiect students' reading K^ins in many other ways; the variables 
we have just discussed refer only to theii* predispositions and background attributes. 
Other aspects of teachers' inputs to student achievement-— such as their teachini^ 
skills, classroom mana^yment. and expertise in iadividualization— are discussed 
under other headings, though they cl :. . iv are important parts of'ieachers' influence 
on children. 

Classroom Setting 

Because classrooms are highly diverse, and complex social and instructional 
environments, we attempted to analyx.e the efiect of the classroom setting on stu- 
dents' reading progress. We asked teachers to tell us about several- aspects of last 
year's classroom setting: the level of disruption ifights. vandalism) in each class- 
room, the number of parents who' visiteo the classroom, and the number of home 
visits made by each teacher. iWe regard the latter two measures as classroom setting 
. indicators because they., characterize the classroom situation in which a strong 
relationship of home and .school experiences is made apparent to children.) After 
taking account of n student's initial achievement (the 5th grade score), background, 
and attendance, we found (not surprisinglv].^that the greater was classroom disrup- 
tion, the smaller was the growth in reading achievement. Disruption may be caused 
by only a few students, but it affects the whole classroom. Valuable instructional 
time is lost as teachers strive to restore order and resolve discipline problems. To 
the extent that school policies and resources can be used to help teachers prevent 
disruption and establish a climate of orderly and productive learning, the improved 
classroom setting can be expected to increase reading achievement. 

Greater numbers. of parent visits to the classroom also were associated with 
higher levels of reading progress."" For our sample of 6th grade teachers, the median 
number of visiting parents was 15 (the median number of home visits was two). We 
speculate that the relationship between parent visits and reading achievement 
♦ reflects teachers' varying success in drawing parents into the educational process. 
We examined whether the individual students whose parents met with the teacher 
had improved reading scores": they did not. Parents visiting in classrooms apparently 
affect students as a group; this finding contributes to our belief that parent visits 
reflect the atmosphere of a classroom. 

If the foregoing- speculations are accurate, a policy that strongly encouraged 
parent visits might not necessarily produce increased reading achievement. This is 
because the number of visits may be simply an indicator oNcertain teachers' 
capabilities for enhancing student motivation and work habits by involving parents. 
If so, merely mandating the use of visitation would not automaticallv raise. other 
teachers' capabilities to affect these processes. However, it is clear th a t^c lass rooms 
that were visited by parents received a benefit in reading^^achievement that applied 
to all of its students. 

Beaiu.so [larent vi.sits and ttMcher.s* home visit.s were highly corryt^led. r ();S^). and a[)pear lo 
measure the same kind ofcla.ssroom atmosphere, we concentrated our quantitative analysis ()n parent 
visits. 
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Curricula and Instructional Methods: Substance of the Reading 
Program 

A teacher's reading program may affect achievement Tor two reasons: because 
of its specific content and approaches, or because of the way it is applied by an 
individual teacher. Without direct observation of each teacher's combination of 
teaching methods, techniques for reading instruction, grouping practices, and use 
of materials, only summary measures of teachers' instructional activities can be 
gathered. The enormous diversity, of pedagogical approaches being used in our 20 
schools further complicates any statistical analysis, based on a restricted number of 
teachers. While recognizing these serious limitations, we collected data on several 
aspects of each teacher's reading curriculum and instructional. methods. 

Our data enabled us to consjder the effect on reading instruction of the following 
.curriculum elements: 

• Techniques for reading instruction (individual diagnosis, word-attack, com- 
prehension, and supplementary reading method's,-' as well as the amount 
of time spent on reading instruction), 

• * Nontraditional teaching techniques (team-teaching and open classroom 

approaches'" that deviate from traditional classroom methods), and 

• • Teachers' use of a variety of materials for different students at the same 

time. . ^ 

In general, the curriculum measures that we investigated were not systemati- 
cally related to better or worse levels of reading achievement. The absence of signifi- 
cant statistical relationships probably means that the curricula were used in some 
effective ways and some ineffective ways, and that on balance there was no predict- 
able effect due to a teacher's merely having used a particular curriculum or tech- 
nique. An important exception to this general conclusion is our finding that teach- 
ers' use of a variety of materials was strongly related to increased reading achieve- 
ment. This finding relates to the way.'teachers actually apply a teaching technique, 
rather than to particular characteristics of ^a technique or approach. 

Because there is a great deal of variation in the v/iiys that any particular reading 
curriculum can be carried out in classrooms, we attempted to formulate a measure 
of the actual behavior of teachers in relation to the most frequently emphasized 
instructional approach to reading, that of individualized and diagnostic instruction. 
We asked teachers how much their school's reading program had actually affected 
their '*use of a greater variety of materials for different children at any one time " 
Our case studies provided evidence that this behavioral measure reflected an impor- 
tant area of reading instruction: the extent to which teachers deal effectively with 
the complex and difficult operations required for individualization. Our finding that 

" Individual diaj(nosis techniques emphasize the specific, highly disaggregated skill weaknesses that 
each child-^has as he or she progresses. Word-attack techniques are aimed at improving a child's ability 
to decode (or "sound out") unfomiliar words, usually emphasizing phonics. Supplementary reading - 
techniques emphasize comprehension through spelling, study skills, and the teaching of reading in other, 
subjects, such as social studies. Comprehension strategies use story reading and oral reading to increase ■ 
students' understanding of what they read. 

Team-teaching is a technique in which two or more teachers share the responsibility for their 
classes, with each teacher teaching certain subjects to all of the students. Open classroom approaches 
involve more child-centered, independent-study tasks than the "teacher-centered" traditional classroom 
in which teacher assignments and the lecture method predominate. 
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a teachers yfse of a greater variety of materials was positively related to reading 
achievement supports the interpretation that an individuali/.ed curriculum (when 
thoroughly put into practice) produces higher acliievement. The likely importance 
ofeflectively implementin^such a reading program led. us to inspect the relationship 
of varied materials usage to the amount of training received by teachers; in addition, 
their correlation is substantial, perhaps because it takes new ideas and skills for 
teachers to effectively, use diverse materials simultaneously. When we combined the 
effects of varied materials usage and teacher training (to reflect the interdependeiVce 
and the frequent joint occurrence of these two classroom inputs), we found a very 
large and significant relationship with reading achievement. (See Table 3.2.) 

The numerous'«5pecific curriculum measures for which we did fiof identify signifi- 
cant relationships to reading outcomes included the following: 

1. VarwuH h^chniques for muling inatnuction. For the four major clusters of 
reading strategies we investig^Ued (individual diagnosis, word-attack, compreh-n- 
sion. and supplementary reading), our general finding is that the use of any particu- 
lar approach seems not to be associated with higher or lower progress in reading. 
(Our measure of individual diagnostic techniques was much less strongly related to 
reading achievement than was the use of varied materials, despite their conceptual 
similarity. We hypothesize that variety of materials is a more "behavioral" measure 
of actual individualization, as compared with teachers' reports of whether so-called 
individualized techniques are in use.) 

2. Nontraditional teaching techniqiieii- We did not discover a significant rela- 
tionship between either, team-teaching or open classroom approaches and students' 
reading achievement. In other words, some students benefited from these teaching 
techniques and others did not: on balance, no systematic effect on reading achieve- 
ment was pfoduced. 

•It would be incorrect to conclude that these techniques are not useful. With the 
exception of the extent to which varied materials are used for different students, 

V which proved to be a strong and effective strategy, we would conclude that there is 
a great deal of variation in the effectiveness with which various reading programs 
have been used in our sample classrooms. 

We also found no significant relationship between achievement and time'spent 
on reading instruction. (Reading time per day ranged from 45 minutes to two hours.) 
We would suggest an interpretation of this finding parallel to our explanation of the 
effect of reading strategies: we do not know that more instruction does riot help, but 
we do believe that there is great variation in how effectively instructional time is"' 

" spent. The implication is that administrators and teachers should concentra^t^n 
policies for enhancing the quality of reading instruction, rather than mandate an 
increase in its quantity. It^appears that the quality of a reading program is not 
necessarily determined by its content or its quantity (within limits). Instead,.quality 
seems lo depend on how well the school's reading program— whatever it is— is 
adapted to the needs and capabilities of each teax:her and classroom. This link 
between a reading program and student achievement can be good or bad, effective 
or ineffective, for'a wide variety of specific reading programs. 

Implementation of Reading Programs 

We investigated the ways in which the 20 .schools implemented their reading 
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proi^rams, B\vimplementation we mean the policies and activities that aH'ected how 
easily, how llexibly. and how thoroughly the reading program was carried out by 
teachers in each school (as opposed to the specific instructional content of'the read- 
ing, program). We studied implementation because educational programs are not 
.selr-propelling;Kthey do not automatically begin to (unction in every situation just / 
as their designer intended they should. Instead, each teacher must find practical ^ 
ways to carry out thVreading program, taking into account his or her strengths and 
weaknesses, students' capabilities, interests and motivations, and the support and 
facilities made available by the school. The various ways in which the new reading 
programs were installed — with or without the use of training, for instance — varied 
greatly for the teachers and schools in our sample. We found that implementation 
decisions do affect the^evel of achievement 4^roduced by reading programs. 
. , The role of teachers in implementing a reading progran) can be either large or 
small, for any particular kind of reading program. In examining the influence of the 
teacher's r*ole ip implementation on improvement in reading, we collected informa- 
tion on whether teachers were encouraged to conform to a predetermined program 
or asked to contribute their own" ideas. Students' reading achievement was reduced . 
where teachers felt that their reading instruction was expected to conform closely 
to the schoors reading program guidelines. , - ' 

Conversely, the more that teachers were encouraged to adapt or modify the 
reading program on an individual classroom basis, the more their students increased 
in reading Achievement. These effects of teachers' flexibility in program implemen- 
tation were quite stro.n^. Because these two measures appear to capture a single 
dimension /of teafher- flexibility in ijnplementation, and since they were highly 
correlatedJ we combined them by multiplication into a. single measure, wljich is 
strongly and significantly related to improved heading: the more flexibility, the 
greater thfe reading achievement. See Table 3.2! (Of course,' there is a limit to this 
finding: when teachers are completely independent in deciding how to teach reading, 
then thei4 is no school-wide program, and school policies are irrelevant to classroom 
outcomesi'i * 

Becaii.^e the teaching of reading is a. difficult and complex task, many of the 
schools u^ed some of their discretionary budget to provide training and resource staff 
to assist t!eachers in putting the reading program into action. We analyzed the effects 
of several of these ^^implementation strategies," which attempt .to. increase^he 
effectiveness of the readifilg program by helping teachers to get the most out of 
whatever reading. system h'^s tee chosen. We found that additional training con- 
tributed to effective implementation of reading programs; .a§ we discussed earlifer, 
we combined pur measure of training with the measure of teachers'^ use of varied 
materials, in order to sharpen the effedl of that aspect" of curriculum on reading 
outcomes. We also found that teachers' informal consultations with other teachers 
about the reading program produced significant advances in their students' reading; 
in a sense, teachers are an expert resource for the^ir col leagues, and the value of their 
experiences for other teachers trying to implement the reading program can be quite 
high. The. relationship of teacher-to-teacher^ consultations to increased reading 
achievement was strong and statist ica^^ty significant. The implication of this finding" 
is that implementation problems oan-be solved by. staff* members in each school. 

While our research did^^iot investigate the costs ofany of these strategies for 
implementing new readjng programs (and so cann9t ju^ge their cost-effectiveness), 



we were able to document the substantial positive influ^ice on readiiVg that is due 
tb'training and teacher-to-teacher consultation. Since these approaches can be used 
with any reading program, they may present opportunities for school officials to 
assist teachers^m implementing a wide range of* instructional methods for reading. 
Our findings regarding the implementation of reading programs reinforce the jdea 
that how a program is carried out may well be more important than its particular 
■ techniques and methods. " 

While the sc\yoo\ inputs we have found to be related to reading achievement are 
significant predictors of reading improvement, tifeir interpretation depends tp sorne-^ 
extent on our assumptions about the v-^ilidity of the district's test scores that we 
analyzed. To-show the extent to which the findings are sensitive to our corrections 
for possible invalidity of test scores. Table 3.3 presents separate analyses for three 
groups of Black students. First, we performed the analysis of effective reading- 
factors for all of the Black students in our sample. Second, we obtained results for 
the sample excluding students in the six classrooms where our field research indi- 
cated test exposure almost^certainly occurred. '(This is the sample corrected for 
probable^test exposure that we used as the basis for the analysis discussed above.) 
Third, we further excluded all students in the four classrooms where a large propor- 
tion of students made very large gains. (We had done additional fieldwork in an 
attempt to locate evidence of test exposure in each of the high-gain classrooms, but 
obtained no additional independent reports of test exposure;) As to be expected, our 
results are sensitive to which groups of students are included and which ai^e ex- 
cluded; we conducted three analyses to enable us to evaluate the irpplications of 

■ ' -,t 

Table 3.3- 

CompariscjSi of Rkcression Resulti?^ with Correction 
FOR Possible Test Exposure " 
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.N'OTE: Table is based on regression anal ys(»s of (itb \*\\\dv C'TBS-Q2 raw reading score" 
on olh ^rade C'TBS'll2 iw reading score, sex, alleiidance. liealtir]>'"t>^^J<*nis. family status, 
father's occupation, mollier's occupation. i\\H\ whet bet* additional services were* received 
uiider remedial reading or ^iftrd programs, and tlv.* variables displayed al)ove. L^nj^-on- 
strained R- is based on the e(|Uation with backji round variables only, excludin^i t^iose 
display(»d abov(». . , ' ^ :/ 
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chixjsiii^' iirnong them, It is our judgment that the effect of school factors is most 
accur ately caf)turecl by using the analysis based on the second group of students 
{excluding , the six classrooms with^direct field evidence of test exposure.)'^ We 
regard the sample that excludes classrooms wi'th reports of test exposure as judi- 
ciously correcting our analysis for potential bias: the preceding discussion of effec- " 
^tive school fiictors is therefore based on it, The other two samples are extreme 
comparison cases, representing hypotheses of "no bias" (the com[)lete sample) and 
"worst-case correction" it'he sample eliminating all high-gain classrooms). As Table 

shows, the sam[)le excluding all high-gain classrooms exhibits weaker effects 
than does the sample excluding only test-exposed cla oonis, (The complete sample 
shows effects that are mostly similar to those of the second, *'middle-ground" sam- 
ple. » The reader who judges yiat all the classrooms exhibiting high gains ought to 
he excluded should exercise caution in regard to our findings. Tfie analysis based on 
>Ue middle-ground sani()le strongly supports the theory and findings of comparable' 
st-H^ies (particular', tfie Rand study of school innovations, Fcderu/ I^ro^rams Sup- 
porting FAlurntioaal ('hfic^r. This congruence of findings is, in itself, corroboration 
f)f the validity of our ^Melerr't^d siunple. 

rhese|)arate(»fI(»ctsoftlie school inputs we found tobe important to readinj^are 
small com[)ar'e(l with their c{)mbine(l [)ower. As an (»xercise designed.to illustrate the 
hypollietical overall effect of the reading a[)pr()aches we have identified as effective, 

have [)erf()rme(l a simulated ex[)erinient based on our study results. Table llA 
|Miv;ey,Js the simulation, [)erf()rnied for sarn[)lej on both the middle-ground 

and Vvorst-ciise assum[)lions r-ega('cling test validity. The uivru^r student in the 
samples had [i r*aw scor-e of about .'{(i on the Sth grade CTUS-Forrn R2. This corre- 
S[)OfKis to a [)er'centile r'ank of about 2f). I lad this student attended the (nuTa/^c school 
and (M"en//.fc chtssr'oom limong those we studied, his or* her CTRS'Q2 raw score at the. 
end of the fJth gr'ade would have been al)out 51, which would have meant placement 
at iIm^ 2M percentile on the national norms for the (ith gr'ade. If, instead, this same 
student had been ex[>ose(| to all of the most effective school'and classroom «/'actors 
we were abli' to Uncover, bis or hov hyp(jlliet ical raw scor'e would have been fuHher 
nu'reas<»d l)y between 7 aru^ 1 raw scor*e points Kiepending on whether all high- 
naming classrooms are f»x('luded, or only t iio.se in whi^^h field evidenc'i^i supported the 
presumption that test exposure occurred). These alternative results w(|uld have 
placr'd (he hyf)otbetical sti^dent at tfie iVAd (r'aw score of 58) to 4.'Jd (raw HCor*e of fM) 
p<»r*( enlj|es. Thus an o[)timal af)f)roach to r*eading instruction has the f)ot.ential of 
adding 10 to 20 per*ceritile f)oirUs to students' (itii grade r'eading scores. In the light 
(jf [jrior r*esear' h findings orr lbr*^downward tr'ends in [)erceritile r'anks of minority 
('hildr*(»n as they gr'ow oldrT. our r-cMiilt^ suggest ihe [)ossil)ility oi r'ev(»rsing the 
expected palternsa' d " airani./ a t urnar'oiuid in test fXM'formance wh^'n yi(»asured 
longitudinally, 

It^'lating fteadin^ / oievi^ment io Krhool Deeisions 

The analysis of the school allor'al »on (juest ion has focufir'd thus far on identifying 

' ' Tliiit MJialvsi'i I'fUM'ctn our hnmpl** (if.»r t fu* "oinil (ril /jirii.hli*" (>i'\*'H\ (•xpoHiiri*; ii Ijmj'm (In* inlorniiit ioti 
v.t' li.iv»' ^jntlicml jihoiit (lie iictuiil on uf';ni( i- ol h-st rxpusiar, witlnnit iKlioUDK (H>(«'nti;il l)iii..iiiK <'lli*<'t/; 
';i ' ilii' rnjfiplcU' Mil III pic flncHi, iinH w(tli!)iit tifidiilv Mi 'I INK 'ln' v'ili iiihilily oI'ii'mi hchivh in (Ik* Hjimpli' 
'.I liiflihf: nil o( iIm' h)>;li u,niu\i\\: "I'lMhriHuii'' IpimI-; m ({m. 
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AVEKAGK AND SIMULATED ReADPNTG ScORKS FOR BlACK CHILDREN, 

FOR Altb}|wate Assumptions on Test Validity 
- ■ — — ^— 



t:iassi's All C:i;:.,srs 

with ViTifii'd with Very 
Hi'iulin^ Scon* 'Pi'st Kxpnsurc Hi^h Cijiins 



r)th m*ii(le 
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Avcra^f ^^lin 1 r).S 1 ;^ 1 

(Uh uriKh' ■ ' 

Avcraui* Viiw scort* ^»\A\ ')].() 
Hyijothctical increase 

iVom cfiVcti VI* factors 12.(5 -7.1 



ny[)()th('tical ()th ^radc raw 

st'ori' with ct'fi'ctivi' factors (i l.'J r)S. l 



NOTIC: Scores arc ha.scd on s:.nii)U*s iff Bhick chihhiMi for whom 
t'onipU't*' data wtTi' availahlr, "Classrs with verified test esposv^re" m'e 
thos«» SIX Musses for whicii there w;i.s field evidence of test exposur(*, 
•'All classef^^with very hi^h gains'* comprise t'oiir more classes for which 
there was some statist iciil evidence th^ai- the district's reading scores may 
not have f)een vidid. Hy potheticiil scores were con^puted iisinjJ regres- 
sion c()effi(*ients in Tahle I);ita on "effective fjictors" are the high- 
est valiies on the school inputs lh;it occurred in our.sam[)le, ^ 



the inputs that are associated with reading achievement. Another appfoach to the 
question of how to improve minority students' reading instruction is to investigate 
whether adeijuate and accurate information is available to administrators at in- 
dividual schools, so that they can act to identify arid correct instructional weak- 
nesses, and can support the strengths of the instructional program. The complexity 
and extremely large size of the LA USD make it unproductive for many important 
educational decisions tobe made centrally. (Our findings regarding teachers' flexibil- 
ity in implementing the reading [)rogram cast doubt on the wisdom of such a policy, 
even if it were possible. In fact, the district s School Preferred Reading Pr^ ;ram 
clearly emphasizes the need for individual schools to have substantial autonomy in 
planning their reading programs.) Therefore, we have attempted to discover 
whether principals possess sufficient information to judge the effectiveness of each 
of their teachers.'" 

We asked principals to describe the performance of their 6th grade teachers on 
several dimensions of classroom style and effectiveness in reading instruction. Their 
responses re[)resent what they believe to be the strengths and weaknesses of each 
of their teachers. These descriptions, taken as a group, were strongly correlated with 
the reading achievement of students in each teacher's classroom. Because it was 

This iMiiilytical approach was liiHt used in Itichard J. Murf)afie'H Htudy. VV/e /ni/x/e/ af Srhnol 
lU'fUiunt'n on'tln' Lvitrtiiiif' nf Inner i'it\ i'htldrcn, llnllin^,'er IMi[)lisl)ifi^ ('()tn()any, Canihridi^c, MnHsa- 
rhusettrt, 1975. 
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difficult to identify which dimension best reflected the actual gains made in a teach- 
er's cbssroom (because of* intercorrelation.s among the assessments), however, we 
combined the multiple measures into a single summary of the principal's assess- 
ment of each teacher. The data indicate that the sum of the principal's descriptions 
of each teacher was a very good predictor of students' reading achievement. (See 
Table 3.5); note that Xhis analysis finds that principals' assesshients, both positive 
and negatjve, are accurate predictors of reading outcomes — not that principals' as- 
sessments proc/i/ce certain outcomes.) 

^nearly, then, principals have the information and the analytics-capacity to 
identify their teachers' instructional strengths as well as the problems facing them. 
Whether or not they have the time, re.sources. and desire to act on that knowledge, 
we cannot say. Yet one implication of this finding is that principals may have enough 
information to make policy decisions at th'e school level. 

We found principdls' asses.«^ments to be good predictors of student reading out- 
comes for both Black and. Mexican American students.(See Table 3.5.) Despite our 
inability to identify statistically significant relationships between specific classroom 
inputs and the reading achievement of Mexican American children, it is clear that 
the principals of schools serving tht?se children are able to identify effective and 
ineffective classrooms, based on their observation of each teacher. 

Answers to the School Allocation Question 

This analysis has attempted to illuminate the central allocation problem con- 
fronting school staff: How can the school's finite supply of resources and staff energy 
be most effectively used to increase reading achievement? We found school factors 
that are strongly related lo reading achievement, as well as numerous factors that 
show no relationship to achievement. We regard these findings as offering sugges- 
tions for educational policy decisions. 

Teachers matter for rsadin^: their sense of efficacy in teaching mifioriiy children 
contributes to reading achicveirient. This finding is important both for teachers — 
whose investment ot' energy and commitnierit in the educational process is too 
frequently underemphasized — and for school officials who may be able to support 
the morale and commitment of teachers. 

Classroorn atnwsphere affects the reading f^iains of all of the students in a class. 
Our measurements of the classroom setting are not subtle, but they confirm that the 
background fbr learningcan a/fect teachers' and students' productivity. Classes with 
high levels of disruption had diminished reading achievement; classrooms with 
frequent parent visitors had increased reading achievement. These measures of the 
setting created by the school and the teacher, and probably other aspects of the 
classroom setting whose effects we did not measure, are significant determinants of 
reading improvement. If there are barriers to the improvement of classroom setting 
that ari^ remediable by using school resources and staff energies, then principals 
may be in a position to produce a reading "payoff'' by removing the barriers. 

Instructional prof^rams can contribute to reading success, though merely intra- 
duciri/}^ a neu' reading system will not necessarily affect achievement. Reading cur- 
ricula do not, by themselves, determine a program's success or failure. Achievement 
varies widely among classrooms that have very similar curricula and reading strate- 
gies. This may imply that any of the reading programs we studied can be effective 
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Table 3.5 

Principals' Assessments as Predictors of 
Reading Achievement 

Mexican 





Black 


American 


I torn 


Students 


Students 


Coefficient of priKcipals' n.s.so.ssnicnts sum 


0.22 


0.10 


t-statlstic 


3.2^1 


1.90 • 


Confidence level for t-statistic 


p < 0.001 


p< O.On 


Mean, standard deviation 


39.7, S.S 


41.0, 7.-1 


R2 of ecjuation 


O.oSO 


0.6G5 


Number of cases 


-105^ 


.')00 



NOTES: Table is based on re^Mossion analysis of 6th tirade CTBS-Q2 
raw reading' score on 5th tirade CTBS-Q2 raw reading' score, sex, atten- 
dance, health prol)lems, family status, father's occupation, mother's 
occupation, a^^e, whether additional services were received under reme- 
dial readin^^ or |j(ifted projirams, and the sum of principals' asses.sments 
of each child's classroom teacher. 

The principals* assessment sum includes the following' components, 
each measured on a cju^titative .scale: 

— Maintaininji consistt'nt and reasonable control and disciphne in the 
classroom ; 

— Plannlnji and executinji le.ssons and other classroom activities crea- 
tively and thoroujihiy; 

—Creating' an atmosphere of excitement and eajierness to learn ("turns 
kids on**); 

—Implementing' the reading' proj^ram as it was laid out, acci^rdinji to 

jiuidelines and on schedule; 
—Effectively usiriji a manajiement system to monitor students' acciul- 

sition of reading' skills; 
— Individualizlnji reading,' instruction to address the needs of each 

learner (o.ji., effective use of flexible jiroupin^O; 
—Effectively combining' comprehension and skills instruction to create 

a balanced reading' curriculum; 
— 1 lelpinji students to develop skills necessary for j^ood performance on 

standardized tests; 
— Developing,' effective learning' centers in roadini^ and other content 

areas. 



depending on how it is used; at the same time, it appears to indicate that the 
implementation of reading instruction, rather than its substance, aflfects success. 
The curriculum approach that did show a relationship to reading growth was the 
use of* varied materials for different children at the same time; the effect of this 
variable was enhanced when it was combined with increased amounts of teacher 
training in how to apply thie reading program. 

Program impkmcniaiion affects feadinff achievement across a range of instruc- 
tional methods and school settings. The way in which a reading program is carried 
out strongly affects how much students learn. This is true even afler taking account 
of the impact of curriculum, classroom setting, and teacher attributes. In particular, 
the more active teachers were in deciding how to implement the reading program, 
the more reading achievement in^proved. Our findings tl.at both the amount of 
training and the extent of teacher-to-teacher consultations are related to readiivg 
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achievement may offer opportunities for improving some programs. In genera!, 
implementation strategies are a crucial and often overlooked component ofeffective 
school programs. 

Principals know which classrooms have problems and which are particularly 
effective. Our analysis demonstrated that principals' assessments of* teachers accu- 
rately predicted which students improved most in reading. While it is likely that 
parents and teachers \yill also have information about school problems, the principal 
has a unique opportunity to observe the whole situation at his or her school, and act 
to improve it. As the full-time managers of their schools' educational programs, 
principals have the knowledge to decide when and where changes are needed. 

These findings show a consistent pattern: the effectiveness of reading program 
depends much more heavily on school and classroom policies and decisions than it 
does on the packaged conte'it of the program or on teachers] background character- 
isfics. The latter two were not among the effective factors we identified. In whatever 
reading program is selected, inuch more important factors appear to be orderliness 
in the classroom, teachers' confidence in their own efficaCy, and the adaptation of 
a variety of materials to perceived classroom needs. So are teacher training, infor- 
mal consultations among teachers of reading, and flexibility for teachers in applying 
the reading program to their particular classrooms. The most promising avenue for 
reading improvement therefore appears to lie in making a reading program effective 
at the individual school and classroom level. No one has yet devised a prepackaged 
program or set of techniques that will automatically produce gains for all schools, 
whether minority or otherwise, merely by being put into operation. 

CONCLUSIONS 

This chapter has dealt with two issues: 

• The management question of the extent to which district-, school-, and 
classroom-level decisions have differential effects on reading achievement, 
and 

• The school allocation question of how a school's limited re^^ources and 
energies can be allocated to produce improved reading. 

In our analysis of the management question, we examined whether or not a 
student's school and classroom had an impact on his or her 6th grade reading 
achievement. We found that individual schools and classrooms are highly signifi- 
cantly related to students' reading achievement, for both Black and Mexican Ameri- 
can children. In our study of the school allocation question, we analyzed the effects 
of a wide variety of factors on achievement. Most of the specific attributes and 
programmatic factors had little effect on reading, providing evidence that classroom- 
level implementation— rather than any technical solution — is the central factor in 
6th graders' reading progress. Moreover, we were able to identify some particular 
school and classroom factors that have substantial power to influence reading 
achievement for Biack students. Despite our efforts to identify such factors for 
Mexican American students, our analysis was confounded by thf effects of un^ 
meiiiiured vnriable^ (and perhaps by variation in the level of En^ilish fluency across 
Mexican American children.) Finally, we found that principals possess accurate 
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information about the relative strengths and weaknesses of* their teachers in read- 
ing instruction, -for both Black and. Mexican American students. 

Our answers to both the management question and the school allocation ques- 
tion tend to reinforce the intent and the policies that make up the district's School 
Preferred Reading Program. The program established substantial local autonomy 
for schools in deciding on their instructional package for reading; our analysis of the 
management question shows that there are, indeed, important effects on reading 
that originate in individual schools and classrooms. The program emphasizes teach- 
er involvement in implementing the reading program; we found that sucTi involve- 
ment increases achievement. The program mandates parent involvement in each 
school's reading program; we found that parent visits to the classroom are associated 
with improved reading. The program requires that schools carefully consider the 
means they would use to implement their reading program, and in particular to 
assure that adequate training and staff development are provided; our analysis 
showed the importance to reading achievement of the implementation strategies 
selected, not just of the techniques of reading instruction. Finally, the program 
places considerable responsibility for reading outcomes in the hands of each school; 
we found that principals' information about reading instruction, in classrooms 
matches the actual record of achievement. Our findings show that the policies of the 
School Preferred Reading Program are important ones for the achievement of 
.minority students. . 
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Chapter 4 

ELEMENTS OF A SUCCESSFUL READING PROGRAM: 
EFFECTIVE SCHOOL AND CLASSROOM FACTORS 

IN PRACTICE 



Our statistical analysis has indicated a number of factors that can contribute to 
improved reading achievement. However, limits on available resources make it 
difficult, if not impossible, to implement school- and classroom-level programs that 
will maximize the positive effect of a// these factors.' This chapter' describes several 
successful techniques, implempntation strategies, and staff characteristics explored 
in our visits to the sample schools. The purpose is to show that, while no single factor 
is sufficient to produce notable gains, a combination of selected factors may do so. 
Consequently, the schools and classrooms included in this chapter were not chosen 
because they were successful in all aspects of their reading programs; rather, certain 
elements of their programs illustrate what the positive factors found in our statisti- 
cal analysis look like in practice. We hope this discussion will be useful to principals 
and teachers seeking to improve their own schools' reading programs. 



SCHOOL LEVEL POLICIES AND CHARACTERISTICS 

Among school-level factors that affect reading achievement, the leadership role 
of the principal is one of the most important. As a group, the principals in our sample 
/ knew which classrooms had problems and which were particularly effective. How 
an individual principal acts on this kind of information constitutes part of his or her 
management task. Principals use a variety of approaches, of course, but the most 
effective principals we observed were able to achieve a balance between a strong 
leadership role for themselves and maximum autonomy for classroom teachers. 
These principals conceived of their role as promoting three broad goals: 

• To create, through example and positive reinforcement, norms that empha- 
size hard work and dedication; 

• To establish incentives for greater professionalism and classroom-level 
innovation; and 

• To maintain an environment that supports teacher efforts in the classroom 
and minimizes outside factors that can disrupt the learning process. 

The principals have worked to achieve these goals in a number of ways. For 
example, some principals stress the contribution the school is making to the com- 
munity. They continually emphasize to teachers the ways that a hard-working staff 
can strengthen the school and, in turn, serve the community well. Principals may 

' Mt'causo nu ofiht' classrooms or schools vvi' ohsorvcd embodied till the ihctors discusj^ed in this 
chapter, wo do not know empirically what tho ed'erts oCa!) the>>e variables v/ould be iCthey w(Te Lsed 
simultaneously,. II* it wore practical to implement all of'them. however, there is no reason toi)olieve they 
would ex(»rt anything other than a positive e fleet on readin^^ achievement. 
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try to encourage greater professionalism and classroom-level innovation in the way 
they allocate extra materials and resources to individual classrooms — giving a pro- 
portionately larger share to teachers who wish to implement new approaches. Other 
principals haye used a faculty newsletter to discuss new and effective techniques 
that particular teachers are trying, thereby highlighting innovative approaches and 
reinforcing teacher initiative. 

Those principals who were most effective in maintaining a school environment 
supportive of teacher efforts visited individual classrooms cflen (perhaps once a 
week) and went there with a specific purpose in mind. For example, they might 
observe whether learning centers had been established or whether students had 
been given clear guidelines for working independently. On some visits, the principal 
was accompanied by the reading coordinator or a reading resource teacher. In any 
event, the principal would try to coordinate his or her perceptions of teacher needs 
and teacher requests for additional material or assistance with the reading special- 
ists. The teachers therefore knew there was administrative concern with and inter- 
est in what went on in the classroom. These visits also provided infoi-mation to 
principals about the kinds of support .that would be most useful. to particular teach- 
ers. Our analysis indicated the importance of classroom visits by parents. Here again 
principals can take constructive action. They can encourage parental and commun- 
ity involvement, and with the right kind of programs can be instrumental in actual- 
• ly bringing parents into the school. Principals at several schools we visited have 
stimulated parental involvenint in the school by establishing extensive activity 
programs and by encouraging teachers to seek the involvement of their students' 
parents. School choirs and other extracurricular activities have been started for the 
students, and a full program of events has been Organized to involve parents, includ- 
ing mother-daughter teas and parental participation in school-sponsored athletic 
events, such as bowling nights and baseball games. All such activities are designed 
to bring parents to the school in an informal and unthreatening way. Principals and 
teachers at schools that have used such techniques have found that parental partici- 
pation in nonacademic events has often expanded into an interest in the school's 
academic program. (The effectiveness of these approaches is further explored in 
Chap. 5, from the perspective of parents.) 

Other payoffs from these activity programs can also affect reading achievement. 
A well-rounded program of extracurricular activities often motivates more children 
to come to school regularly (and thus to reading classes). Principals believe that 
these programs raise teacher morale. Teachers see that parents are interested in tl\e 
school, sometimes to the point of paying attention to the maintenance and cleanli- 
ness of* the school physical plant. Activity programs to involve parents may appear 
to be related only indirectly to reading achievement, but they affect such factors as 
parental classroom visits and teacher morale, which affect reading achievement 
more directly. 



CLASSROOM ATMOSPHERE AND TEACHER ATTRIBUTES 

Teacher attributes and general classroom atmosphere ar^^ important to reading 
achievement As indicated earlier, l.-^v/ever, teacher attitudei; are more significant 
than their background characteristics. The most effective reading teachers had a 
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strong sense of personal efficacy in teaching minority children; they believed they 
could "get through" even to children with shaky motivation or home background. 

Their confidence does not mean they ignored the ways their students might be 
disadvantaged. On the contrary, they were well aware of socioeconomic problems 
and sor;iietimes used them to motivate their students. For example, at the beginning 
of the year, one teacher drew bar graphs on the blackboard and indicated where the 
class placed in reading based on national norms. He then delivered a pep talk to the 
class. "This is where they say you are (near the bottom of the graph) because you're 
poor and Black. Can you think of any. reaiion why you should be down here? I can't, 
and I think you should be up here (close to the mean)." This exercise had a dual 
purpose: to challenge the students to perform better and to show them exactly what 
the class goals were in reading achievement. Throughout the year, the teacher and 
students referred to the graph and assessed their progress. Other teachers were less 
overt in their efforts to overcome low student motivation and home environment, 
but were still aware of these as important factors affecting student performance. 
Some teachers, for example, devised a set of classroom games to improve the self- 
concept of their students. But whatever technique these teachers chose to deal with 
the special needs of their students, they remained confident that their teaching 
would yield positivb results. 

Another factor found to contribute to improved reading achievement was teach- 
er visits with parents (either in the classroom or at J;he students' homes). Most 
teachers who worked to maximize the number of these visits. believed they served 
two purposes. First of all, by meeting with parents, teachers were able to get a better 
idea of what made their students "tick"— see the relationship between classroom 
behavior and the students' life outside school. Secondly, these teachers believed that 
classroom discipline was less of a problem if students knew the teacher was in 
contact with their parents and that classrooom discipline would be reinforced in the 
home. This reinforcement, however, was not confined to disciplinary matters; for 
example, one teacher used letters to parents and an extraordinary number of home 
.visits to encourage parents to read with their children. By the end of the school year, 
one-third of the parents of this teacher's ::.adents were reading regularly with th^eir 
children. 

As these examples illustrate, the successful teachers were willing to expend 
considerable effort, and the results showed up in the classroom atmosphere they 
created. Their classrooms were well organized and suffered few disruptions. Stu- 
dents knew what was expected of them, and knew the purpose of each instructional 
unit. Above all, these teachers were able to challenge and motivate their studeVats 
by achieving a balance between f-ositive reinforcement and strict discipline. / 

READING PROGRAM IMPLEMENTATION ^ 

Another set of significant variables were rehUed to program implementation. 
One important factor was the use of school resources for teacher in-service training. 
The schools in our sample varied in the amount and kind of staff in-service they 
provided. One school, however, devised a plan that provided consistent, ongoing staff 
development in a fairly inexpensive way. The school hired a physical education 
coach who works with all classes at each grade-level for one period a day. During 
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this time, the teacher?? at a given grade-level attend btaff* development sessions 
conducted by the school's math and reading coordinators. These^sessions are orient- 
ed to topics and problems that the teachers themselves raise. This type of staff* 
in-service has the advantage of providing regular and practical staff development as 
well as physical education instruction for stu(ients, all at a relatively low cost. (Of 
course/we found that other programs of staff development also had positive effects 
on student achievement.) 

Another aspect of program implementation is the extent of interaction among 
classroom teachers. We found that teachers' informal consultations with other 
u^achers about the reading program produced significant advances in students' 
reading achievement. At some schools this consultation is done on a regular basis 
and on the teachers* own initiative. At one school, for example, the 6th grade 
teachers agreed to meet during their lunch hour throughout -the first year of the 
school's Preferred Reading Program. They discussed common problems and ex- 
changed ideas about the modification and adaption of reading prograni materials. 
At other schools, interaction among faculty members was built into the schools* 
in-service program. For example, one set of elementary schools that feed into the 
same junior high school take turns presenting a classroom demonstration of their 
reading program, followed by a workshop two weeks later. At least one teacher from 
each school in the complex attends and then reports back to his or her school. This 
type of program allows teachers tosee how reading instruction is conducted in other 
schools and, at the same time, facilitates teacher interaction both with a given school 
and across a number of schools. 

Our research also indicates that the more teachers are encouraged to adapt or 
modify the reading program, the greater is the increase in their students' reading 
achievement. Teachers modified their schools' reading programs in a variety of 
ways. For example, a number of teachers prepared written exercises to correspond 
to a reading program*s oral drills, while others used supplementary book.s and 
magazines to apply reading lessons in ways relevant to student experience and 
^ interest. One aspect of program adaption that several teachers considered important 
was their effort to get interesting books into the students' homes. Although there 
was always the chance that some books might not be returned to the school, these 
teachers believed the -payoff from students reading at home, either alone or with 
their parents, was well worth any lost books. 

Our study concluded that, at least with regard to the schools in our sample, no 
- prepackaged reading program or technology will automatically produce effective 
results. The significant factor is the manner in which individual schools and teach- 
ers adapt a particular program to their students' needs. We did find, however, that 
individualized and diagnostic instruction as a classroom behavior positively affects 
reading achievement. But again, individualized instruction is a useful technique 
only to the extent that teachers understand the underlying basis of individualization 
and actually carry it out effectively. For example, we observed several classrooms 
using DRP (Development Reading Program), a program designed as individualized 
instruction. In some of these classrooms, however, the teachers essentially did no 
more than go through the motions, dispensing a variety of materials and supposedly 
dividing students into skill-level groupings; it was clear that these teachers did not 
understand the rationale of the 'program and were not making adequate distinctions 
aniong the skill-levels of their students. On the other hand, we observed other 
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classrooms where the reading program was primarily oriented toward basal readers, 
but the teachers were aware of'differences among their students, devised individual- 
ized materials, and could target their instruction to specific skill-level groupings. 



CONCLUSIONS 

As noted elsewhere in this report, neither prepackaged reading *:echniquos nor 
specific teacher background characteristics were among'the factors found to contrib- 
'ute to improved reading achievement. Instead, we found that policies enhancing the 
im£)lementation of wht tever^'reading program the school had selected were effective^ 
in raising students' reading scores. The examples presented in this chapter show 
that ^^ividual principals and teachers can approach the ask of reading instruction 
in a variety of ways. No school or classroom maximized all the factors that contrib- 
ute to reading achievement, but the schools and classrooms discussed in this chapter 
eHectively\sed some of those factors to enhance their reading programs. In spite 
of the diversitv of approaches and techniques we observed, however, one generaliza- 
tion can be made about the elements of a successful reading program: in practice, 
these factors refl^^t a belief on the part ofprincipals and teachers that children can 
be taught to read, regardless of motivation or background, and that reading instruc- 
tion can be orienteavto the needs of individual students. 
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Chapter 5 

PARENT AND CoiviMUNITY INVOLVEMENT IN THE 

SCHOOLS 



The past ten years have witnessed increasing parent and community involve- 
ment in the schools. Community involvement is seen both as an end in itself, and 
as a way to aHect educational outcomes. Most studies have concentrated on the 
former view; to date, no studies have demonstrated that community involvement of 
a certain kind over a prescribed time period affects educational outcomes. Problems 
encountered in obtaining comparable experimental and control populations, in 
measuring participation, and in specifying educational outcomes make such studies 
difficult. As a result, we are lefl with case-study information that leads us to believe 
that community involvement in a school is important without knowing exactly how" 
it is important. 

In this small substudy^with its limited' resources, we could not hope to ^o much 
beyond previous work in^ d^?monstrating the effects of parent and community in- 
volvement on educational outcomes — in this case, reading achievement. 

Nevertheless, we believed we could obtain a more con^plete picture or our 20 
schools if we analyzed some information abQut their communities. We therefore 
conducted a series of about 40 interviews with parents, community residents, agency 
• personnel, and community organization people, collecting information about the 
role, function, and perceived effectiveness of parents and community members vyith- 
in the schools.' 



METHODS 

A largely open-ended imc-rviL-w schedule was designed to assess the involvement 
and influence of parents and ^.immunity groups with the schools, -with-particular 
emphasis on reading; and to determine the extent of openness of the school to the 
community, including activities undertaken by the school to encourage parent and 
community participation. We strove to make the instrument consistent with com- 
munity '^oncerns. The instrument was reviewed by community members with 
experience in program evaluation, who assured the research team that it was both 
comprehensive and sensitive to community variables. 

Interviews were limited to a random subsample often schools from the original 
sam; le: five each from the Mexican American and Black communities. The schools 
seW. ted reflected the spectrum of socioeconomic condi|:ions to be found in those 
coummunities. Intervif^ws were conducted by study team members who were ethni- 
cally ]u*^ntified with the respective minority communities included in the study. 

' .'V 5tc'tr./'\: Confmittee. mudc up of representatives of each of the ethnic education commissions, 
advised the roi-.'arch team. This committee consisted oI'Mrs. Ruby A^uilar, Mexican American Kducation 
Coinini.ssior,: Mr. Walter Jones, Black Education C\»mniission: Ms. Ann Mikol. American Indian Educa- 
tion Commission, j.nd Mrs. Nancy Oda. Asian Aniorican Education Commission. 
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Respondents were sought from among parents' groups (both those organized 
within the school and those outside), community groups who come in contact with 
the schools, and individual parents and community members known to be active in 
the schools or in school-related .issues.' In general, three respondents were inter- 
viewed from each school and several others from the community at large. Those 
interviewed included educational aides, student volunteers, members of community 
agencies, and district personnel who worked with the schools through the various 
area offices." ' * J"^ 



LEVEL OP COMMUNITY INVOLVEMENT / 

' The interview data- revealed a pattern of active school solicitation of parent and 
community involvement. However, certain kinds of parent/community efforts ap- 
peared to be. much more effective than others. Large school-to-school differences 
were found in the amount of participation by community and parents. These differ- 
ences were consistent wi^h the extent to which the scliool structured its relationship 
with par&ntsand cormifunity to m^e^^ra^e them («fo the school and its activities.-The 
level of involvement did not vary as a simple function of neighborhood stability and 
income level. One of the schools with a lower degree of participation and school/ 
community integration was in a visibly stable neighborhood of single-family homes, 
while one of the schools with a higher participation and integration level was in a 
.neighborhood which was rapidly changing, and in which there were many multiple 
unit dwellings, generally crowded housing conditions, and high levels of transiency. 
It may nfbre difficult to obtain parent involvement in more transient communi- 
ties, but the key to such involvement appears to be the leadership both of school 
administrators and of concerned community residents. 

Based on the data obtained from the respondents, and observations of tangible 
physical and behavioral variables within the schools, a picture of community partici- 
pation was constructed that is represented by a continuum of school/community 
integration. Table 5.1 illustrates this continuum, with a range of'points from column 
1 on the extreme left (a relatively low degree of integration of the community into 
the school) to column 5 on the exti:^me right (a relatively high degree of integration). 
Schools- in each subsample were then ranked in terms of level of integration.*' 

The upper row of Table fe.l represents the various policy stances taken by the 
schools relative to community inviolvement. Listed directly .below them are exam- 
ples of activities schools may initiate to carry out those policies. 

Columns 1 and 2 represent relatively low levels of school/community integra- 
tion. The schools that fall into these categories appear to make outreach attempts 
in a traditional way. Typically, the school develops a program and asks parents to 
become involved. The midpoint of the continuum (column 3) represents the begin- 

* AUompts were made to idenlily ii spectrum ofopinion in the sdiooLs. linwever. this was not alway.s 
rM)ssibIe because of the problem.s presentee] by respondent identification and selection. Those identified 
by the school as active are most likely to be proponents. Dissidents, in Mt*'H*ral. are either not identified 
or no longer involved with the.schools. This raises questions ofresponse bia.s. which are common to many 
research efforts that attempt to determine "community" attitudes' vissi-vis some .subject. It is also 
important to recoKnize that our analysis is based on a small sample of* interviews at each school.. 

' The continuum represents only a convenient way to discuss tJjc sc hools. Since schools ujK)n which 
the continuum was ba.sed were then ranked in terms ofthe continuum, it should not be considered a test 
or validation of the approach. 



53 



43 



r 

r • Tabls 5.1 



A Continuum of School/Community Integration 



Puliry }M»>il n»n> 




I'rnvijlrs pri>iiTi> 


(HilriMi'li pi'iiLianis 


Sparc pi'i)Vi<li-<l 


.•^jKlfl- Willi I'tptip 


lak4't) hv the 


involvrtnrnl 


IW p.i.vnis 


ill, It iM-ni'Iit i-oinnni- 


tV>r p.vtTnl> ni 


mi nt or sri vti'i s 


^. M-htM»l>".-. l.iliv.' 






iM\x 1 !i>t:.it. innni 


siliool 


iisrtnl In I'Minniii 


ti» i-imuiiuniiy 










nn\ .ip.h'l trnin 


itutttvi-fni'iii 










sriiool ,11', -lis 


I'!\.mH»U'>. 


Si>n(l> iiiili>> liiiri-M> 


■ Asks lor lii'lp 


( 'KisM' . ,uii! pint: Is 


l*.in>ni> kimw 


l'-tri'nls" iiii»ill i tiin|> 




1 iniiirilini:ii.il iM. 


in spi'i-iTif sflnud 


ili.it ii,i\r Ml) i-<»nti<-i-- 


whrvr tli.'V i-..i>. 


P»*<l U III) sl UllIll 




n<>M-l-<ni:ii>ii- 


pn.i.-i-ts i{)iipi-i 


tinti hi lllr niliii.inL; 


visi- r us. or- 


m.irllint's tll.il iMM 




>|ii';ikinii iift'j>) .. 


.lnvi>. i-.Hi.ly s ,l,.. 


s< ll.»ul pmijr.iiil 


1 U'l'> II-' ,1 spci-l.ll 


i>r i.snl li.upnsr.,i.,l . 






CnWn i\r M.ivo t. s 


1 spi «'i.il iilsi 1 Vn-i- 


riinin tin pjci'ilts 


llfr.ls 






^\ \\ 1 


pri>i:r.iiivsi 


i«inniunnt\' 
p.i.vnIiU 





ning of a broader approach to outreach; these schools provided programs and ser- 
vices for community people as well as parents. Additionally, the school may begin 
to have visibility in the neighborhood at community functions not directly related 
to the educational program. Columns 4 and 5 represent still higher levels of outreach 
and involvement,.to the point that the school makes space available l:o parents and 
community people. The provision qf spac^.appears to foster a feeling of "belonging" 
.among parents and community.** ' * 

The schools in our subsample were found on all points of this continuum. Almost 
all the schools had some very active parents— but the numbers of parents and 
comimunity individuals those parents could in turn mobilize or^elegate responsibil- 
ity to were much smaller at the schools with a lowef;d^gree of community involve- 
Iment than at other schools. ' ^ . 

I Issues- and patterns of involvement varied between the Black and Mexijan 
I American subsamples. Different interviewers rated the schools within each subsam- 
ple; therefore, these findings will be presented separately. 
I • . 

\ ■ , < ^ ' 

j THE BLACK COMMUNITY 

Schools / . . 

Parents at schools that exhibited low school/community involvement tended to . 
be proud of the school, and expressed fewer concerns about both their ow,n role in 
school decisionmaking and the, competence of the school's staff than was the case at 
the higher-involvement schools. Characteristically, they spoke of their schools as 
making certain things available to parents, and tended to rely heavily on the school 
administration for direction. Community involvement at these schools can best be 
characterized as passive. The schools' reia'.ionship to the Parent Advisory Councils . ^ 
and P'.T.A. was supportive and open, but these parents tended to see themselves and^-:-- 

* This provision of space (as in categories 4 and 5 on the scal'^) is niodiiierl in our rutin;»s to take into 
consideration thecontin^^encies ofdifFerinK amounts ofavailableHpace anions schools. Thus, this catej^ory 
was deli n'-d as actual space allotted or parents* and community members* perceptions ol* freedom to move 
about in ihe space of the school. 
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to be seen by the school as lan^Tntial to school decisions iuu! activities. Parents >vere 
not Kt^nerally included in school decisionmaking councils. 

( olumn :) itiT\j)>hr7ri repre^ midpoint ofschool/comniunity inte^^raticfi. 
^ Schools at thij^-^Jom ixi}6 higher in the Black coninuinities tended lo have parents 
who had beet/actile and involved with the school lor lon^^ periods of tinu^say, over 
lour years, y hese/parents are knowledKeabfe about 'the pro^^ress ol^the school.. and 
they are no/ably able to mobilize others. Althou^^h only a few parents may attend 
any ^Mven Advisory Council meeting, they know how to mobilize cot:;munity intere.st 
when an important issue arises. Parents in these schools have begun to articulate 
their strategies for getting what they want for the school Iroiii the Board of Educa- 
tion. The column 3 school in the Black community sponsored a program ol^comm un- 
ity events, and several parents were intent on bringing other community groups into 
contact with the schools., 

In the schools related to columns 4 and 5 in the Black community subsample, 
parents were in and around the building fairly continuously. They, were included on 
planning and monitoring committees for all school events and activities, not merely 
those involving compensatory programs or auxiliary services. Although the parents 
at one school did not have their oK'n room, they were familiar enough with the 
school's physical plan to be able to find a room in \vhich they could talk with our 
interviewers in privacy. Attendance at the average Adviso\v Council meeting was 
high— about 40 icompared with abOut 15 at column 1 and 2 schools). 

In the Black community school^with the most parent Y.'>mmunity integration, 
parents were organized even before the school was estauli.^hed. They were involved 
from its inception and influenced both the naming of thn .. - ol and the naming of 
the Child Care Center. Children's Centers in the Los Angeles Unified School District 
general ly assume the names of the schools at which they are located, but in this case, 
the community residents strongly felt it should have its own name. This school is 
distinguished in other ways as well. Classes in sewing, miflir.^^y design, and typing 
are oflered to community residents, and the parents have a conference room avail- 
able to them at all time.s. The Parent Advisory Council has - .hcommittces that 
monitor such disparate, subjects as curriculum, employmen* of school staff, and 
physical plant maintenance. Attendance at ti.eTarent Advisor> Council meetings 
was reported to average around 50. 

types of Parent and Community Involvement in the Black 
Communities ' 

Nonparents appear to be involved significantly only in the schools scoring mod- 
erate and high in community integration. In the most highly integrated schools 
^columns 4 and 5), there appears to be substantial involvement by students of local 
uni<'ersities, as well as active involvement by nonparent neighborhood residents. In 
both schools there is a .senior citizens group of volunteers, and in all three an open 
environment for volunteer activities. 

Involvement with reading was generally low in all schools. In most cases, the 
staif selected the reading program and sought approval of the Advi.sory Council. In 
some schools parents were asked to approve a fait acvompli while in others alterna- 
tive programs were presented but the prior preference or selection of teachers was 
made clear. In only one school, the one ranking highest in con^munity integration, 
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did it appear that tlv ents were objectively educated ay to the merits and draw- 
backs of each progran ) allowed to make their own informed decision. Teachers 
participated in this r . . so ihe two groups were essentially acting as equals in 
the docisionmnk . : "ort- ^ 



THE MEXICAN /mERICAN COMMUr^ITY 
Schools 

The two schools in the Mexican American subsample at the lowest level (column 
1) ofschool/community integration attempted to interest parents by sending home 
notes f ncouraging the parents l.i vir'it the schools, but did not suggest specific roles 
for the parents. There, was no school-wide policy on the role of parents in the 
classrooms: it ^vas left up to the parent to discover whether a particular classroom 
teacher was receptive to his or her presence. As in the Black schools with low levels 
of community/school integration, parent participation was characterized by low 
levels of awareness of possible parent roles and school issues. Attendance at parent 
meetings was lowTahd the few active parents in the school seemed at a loss as to 
how to interest more parents. In one school, respondents felt the school was doing 
all it could to involve parents; in the other school there was a strong feeling that 
the school could be doing more. Neither of these schools enjoyed any significant level 
of involvement by community groups. 

Three of the five schools in the Mexican American subsample were relatively 
high in school/community integration (columns 3, 4 and 5, respectively). In these 
schools there was active participation by community agencies and groups and in- 
creased' visibility of parents at the school. These schools provided services of a 
nonschool-related nature aimed at community concerns: workshops on immigration, 
legal services, and welfare rightte, among others. These workshops brought in mem- 
bers of the community at large And created an image of the school as a community 
resource center. Two of these schools provided physical space for parents and parent 
projects. These parents' rooms functioned as an integrative mechanism, actively 
involving those who might otherwiW be reluctant to participate because they did not 
view such participation as appropriate, or because of embarrassment at not speak- 
ing English. The existence of onrgqipg-projects that used the special skills of the 
parents helped them to define their, ^oles in the school. 

One school (column 5) had gone bleyond providing space and parent projects. In 
th^s sch'^ol, sewing machines had be^n purchased and parents were encouraged to 
use them for personal needs or to hfelp make clothing for needy members of the 
community. . ; , 

While certain issues and cultural characteristics may bring together members 
of the Mexican American community, these same factors, if neglected, may create 
barriers to successful school-community relations. One example is language, oflen 
an obstacle in the school/community relationship. Many monolingual Spanish- 
speakmg parents are active and make up a significant number of the parents on 
Parent Advisory Councils, yet they njiay not make informed decisions. Meetings are 
conducted in English and oflen are not translated because parents may be embar- 
rassed to admit that they do not understand English. Or, translation may only 
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outline the proceedings, and parents may not trust the translator. This problem is 
so pervasive that the level of awdrenef^s of monolingual Spanifih-^peaking parents 
can often be used as a gauge of the overall parent awareness in these schools. If* 
monolingual Opanish-speakiiig -parents are well apprised of the issues in their 
schools, it is likely that the school is making a sincere effort to communicate with 
the conimuniLy and respond \.j its needs. 

Types of Parent and Community Involvement in 
the Mexican American Communities 

In the Mexican American schools, parents were involved as teacher helpers, 
classroom aides, and rioon aides, .'id worked on special projects. In all of the schools, 
there was some paid parent training tied to government sponsored educational 
programs, which drew some parents into the school. They also participated by sitting 
. on the Parent Advisory Council, P.T.A., or various special programs' councils (e.g., 
Follow Through, Early Childhood Education). In one school, parents were invitc^d to 
give workshops or classes on special skills they possessed. They sometimes func- 
tioned as representatives of the school at city-wide and district-wide meetings. In the 
schcols v>'ith the highest levels of community integration, parents participated by 
availing themselvei; of services provided by the school. 

The involvement of nonparent, community-based groups in the schools was an 
important discriminator between. schools with lower and higher levels of integra- 
tion. In the East Los Angeles area, community, high school, and university-affiliated 
groups have played a significant role in the schools. One organization^based in the 
East Los Angeles area has been responsible for training community members in 
techniques fbr organizing parents in schools. Four of the five schools in the Mexican 
American subsample were recipients of the services of thisorganization. The schools 
that had parent workshops sponsored by the organization were those that ranked 
at the higher levels of community/school integration. 

An organization affiliated with a local university had presented weekly pro- 
grams aimed at ethnic identity and personal growth in several of the 6th ^rade 
classrooms in the three most highly integrated schools in the sample. \ 

While it is difficult to state whether high levels of school/community iri-tegrati^^ 
caused a school to have significant participation community groups, or whether^ 
the higher levels of community participation was a cause of a strengthened school/ 
-community relationship, it is important to note that the two factors correlated. The 
existence of nonparent, community-based groups in the schools was an important 
discriminator bet\v%en low (column 1) and higher (column 3 and above) schools. 

FACTORS IMPORTANT IN SCHOOL COMMUNITY 
RELATIONS 

• High levels of parent and community activity did not necessarily mean that 
parents were effective in setting and achieving goals. Those schools with low levels 
of school/community integration were characterized by few, if any, demands by the 
community. However, even in some schools with relatively high community involve- 
ment and activity, parents could not remember actually having made a demand on 
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the school, and there was relatively little awareness of how to go about making 
changes or expressing demands. In the schools where persons were most able to 
point to parent-initiated or community-initiated accomplishments, the respondents 
more readily related minor dissatisfactions and had a.sense that they could create 
a climate of productive tension until they got what they wanted. There was a great 
deal of awareness in these schools (basically, 4 and 5 on the scale) of the administra- 
tive hierarchy, all the way up to the Board of Education, Several of the parents in 
these communities had dealt w/l: school administrators at vat-ious levels in order 
to gain satisfaction on an issue ot concern to the community. High parent/commun- 
ity etficacy in all the schools surveyed was characterized by a high levc 1 of av^'-reness 
o(\>ch jol/community issues, familiarity with mot hods for obtaining satisfaction that 
transcended the immediate school setting, ar ili - ability to generate productive 
tension within the school in order to ensure tha, parent/community concerns were 
acted upon. In schools where parent efficacy appeared to be low, tensions were 
played down and parents exhibited relatively little awareness of alternatives for 
effecting change. 

The role of the principal was repeatedly stressed as important in establishing 
a climate for school/community relations. In two schools, the principals leadership 
was cited as the impetus for community representation on school committees, in- 
cluding employment screening and the selection of the reading program to be used. 
In these schools, the principal took an active stance not only in involving the 
parents, but in educating them so that they could make informed choices. As a 
result, parents backed the principal to the hilt, even to the extent of going to the 
Board of Education to push for the favorable resolution of issues perceived to affect 
the interest of the school. In the schools characterized by active principal/commun- 
ity relations, parents appeared lo regard the school as theirs, largely open to their 
input, and education was seen as the joint responsibility of the parents and school 
staff. In the schools with less active principal/community relations, there had been 
one or more changes of principal in recent years, and it was sometimes the case that 
the new principal was struggling to transfoTm relative apathy into community 
involvement — or had difficulty in maintaining a previously established high level of 
commitment. . ^ 1 - 



COMMUNITY INVOLVEMENT AND READING GAINS 

While community involvement has "fritrinsic value, the specific relationship 
between community involvement and reading scores is also of concern. It does not 
necessarily follow that a high level of school involvement by both community and 
parents will influence reading achievement. To roughly assess the relationship be- 
tween parent involvement and student gain, we ordered schools in our community 
subsample according to both their perceived levels of community involvement and 
their percentile gains in reading achievement from grades 4 to 6, and compared the 
ranlc-orderings (see table 5.2). These orderings suggest that for Black schools, levels 
of parent involvement appear to relate rather closely to student reading gains, an 
observation consistent with the results of our statistical analysis (Chap. 3), which 
found that high levels of teacher-parent contact were associated with reading gains. 
No such relationship appears in the Mexican American subsample, although it 
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Table 5.2 

Rank Ordering on Level ok Community 
Involvement. AND Reading Gains" 



Black 

C-Dinmunity Subsamplc 


Mexican .American 
Community SubsampU» 


C'oniniLMiity Ui»iulin^ 
School InvolvcnuMit ^corc 0;un 


Community Heading 
School Involvement Score (Jain 


B f) +5 

J 3 -3 
M 2 -1 
I 1 -11 


S ' -2 
K 1 -IS 

P 3 

C I,;V» 

D 1..^^' -(i 


'Viradcs -1 to 6 mean percentile ^ain.s. 
^^Tlie hi^hi'st rank is 5. 

^Ciain scores at this school wwv jiuliied invalid hi'causi' of lest i«xposuri' 
problems. Since this school was- eliminated from the analysis in Chap. 2, 
we have eliminated the liain score from this table. However, the pattern 



ol" community variables tor this school was consistent with the fiiulih^s \\>\- 
()lh<*r schools in the Black subsamide. 

■ 1 leil ranking. 



should be noted that the school that was most effective in that subsample, if not in 
producing reading gains, then in holding back losses, was also the school with the 
highest level of community /school integration and awareness among monol ingual 
Spanish-speaking parents. This of course does not explain the absence of a relation- 
ship between reading scores and school /community integration rankings in the 
remaining schools in the sample. 

On the baj^is of the data we collected and our experience in related research, we 
can speculate on some possible reasons for the apparent relationship between parent 
and community involvement and student readinggains in the Black sample, and the 
lack of such a relationship in the Mexican American sample. We noted earlier that 
leveUof-par-ent/community activity cannot be equated-with-efficacy in influencing 
reading achievement. This is particularly so in Mexican American communities. 
Language (and other factors) may be creating barriers to parent/community effec- 
tiveness; we may well be observing parallel processes in the classroom and commun- 
ity. In addition, the immediate needs of the community may at times be more salient 
than the specific concerns of classroom instruction. Outreach programs that offer 
services may increase the level of school/community integration and benefit partici- 
pants without strongly^affecting educational programs or outcomes. 

Outreach programs ia the Black communities that provide services are less 
likely to be the initial attraction for parent involvement in the schools. Sugh pro- 
grams increase the level of school/community integration and help to meet com- 
munity needs and concerns but are more likely to include an educational orienta- 
tion. 
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We say little about causality, of course. At the same time, the pattern of findings 
presents some implications for policy. It appears that in Black communities, level 
of involvement in the schools may be related to reading gains. No such relationship 
was found in the Mexican American communities. The mixed pattern of effect in our 
sample of Mexican American schools suggests the possibility of more complex rela- 
tionships that are obscured by the presence of variables we did no) measure. It is 
the judgment of the interviewers that if community needs and pro'6esses were better 
understood, a relationship between level of involvement and gains might be found 
in Mexican American as well as Black communities. We believe that parent-com- 
munity involvement should continue to be strongly encouraged in both communities 
and that further efforts to clarify the relationships in the Mexican A^merican com- 
munity should be considered. 
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Chapter 6 
CONCLUSIONS 



OVERALL ASSESSMENT 

In general, our findings confirm the appropriateness of the current district 
reading program policies of school-level goal setting, teacher involvement in pro- 
gram planning/and the allocation of important decisionmaking authority to schools 
and teachers. We found that for both Black and Mexican American students, school 
and classroom inputs were directly responsible for significant changes in students' 
reading achievement. In other words, school and classroom decisions matter for the 
education of the minority students we studied, over and above the importance of 
student background characteristics such as socioeconomic status and prior reading 
knowledge. 

We also identified specific classroom and school factors that were related to 
reading achievement in our sample of Black children, though the strength of these 
findings depends on assumptions aboUt the validity of test results arising from 
evidence of test exposure. We were unable to identify specific school or programmat- 
ic factors related to the real gains we discovered for Mexican American children, 
even though the evidence is clear that school and classroom inputs do in fact matter 
for the Mexican American sample. 

Our limited analysis of the effects of parent and community involvement on 
education leads us to believe that such involvement should be encouraged. Although 
our findings are only suggestive, it appears that vigorous school efforts to involve the 
community are oflen associated with improved outcomes for children's education. 

The following discussion details this overall assessment by summaVizing the 
specific findings for our sample. We then consider the applicability of these findings 
to other schools and to future policies. 



SUMMARY OF FINDINGS 

Reliability of T^st Resu]^^ ' \ 

Reliability analysis is performed to assess whether test results are internally 
consistent and reasonably free from random errors and other inaccuracies. We 
found solid evidence in our data that the reading tests used by the LAUSD meet 
established reliability standards. Reliabilities were high for both the large sample 
of student records we analyzed, and for each school. 

Validity of Test Results 

Our analysis of test validity is relevant both to the interpretation of our findings 
on efl^ective school policies and to the district's methods of assessing school-by-school 
changes in reading achievement. Our first point concerns the way that reading gains 



50 



51 



are measured. The current policy is to report cross-sectional change, that is, to 
compare different groups of students from one year to the next. But year-to-year 
differences can be largely due to differences in the ability and composition of'succes- 
sive groups ofstudents and therefore are not a truly valid measure of'improvenient. 
To test this, ^ye compared changes in successive 6th grade median scores (the dis- 
trict's measure) with changes in individual children's scores over time^ and found 
only a moderate rank order correlation. To assess true change, we must compare the 
performance' of the same group ofstudents between, say, 1974 and 1975 as they 
passed through the 5th and 6th grades. For that reason, we recommend that the 
district consider the use of longitudinal cohort analysis like the one performed for 
this study. This involves collecting and reporting data on the progress of individual 
students over time, rather than grade level data on successive cohorts. 

Our second set of comments concerns test preparation. Used appropriately, test 
preparation enhance^j the validity of test scores and allows meaningful cross-school 
and cross-classroom comparisons. However^ overzealous test preparation can pro- 
duce invalid scores and mask failures to educate. Our findings indicate that the level 
and range of test prepa»*ation activity varied widely. Many teachers reported consid- 
erable pressure to show test score gams, and few saw nnuch utility in test scores as 
indicators of students' performance. This combination creates an environment that 
is ripe for ovorzealous preparation. Exposure of children to tests or at least intensive 
drilling on material likely to be covered on upcoming tests can—and we believe 
sometimes did — occur in a few classrooms. We emphasize, however, that for about 
90 percent of the teachers we surveyed no such questions as to the validity of 
measured gains are warranted. 

Effect of School and Classroom Factors on Heading Achievement 

Students who had similar backgrounds and prior achievement levels, but who 
hcd differ?nt school arid classroom experiences, achieved different rates of reading 
/yH;qrc.ss. That is, some schools and some classrooms within a school contributed 
more to their student's achievement than did others. This result held for b.th 
Mexican American and Black children, and did not change when we excluded test 
outcome data that may have been spurious as a result of test exposure. 

We infer that school and classroom effects on reading progress were strong 
because very different kindd of influences— school policies and classroom settings- 
were received by children depending on where they were enrolled. This finding lends 
support to district policy, which grants authority and resources to local schools to 
design and operate reading programs. 

We also found that at both predominantly Black and Mexican American schools, 
principals can make highly accurate assessments of the instructional ability of their 
teachers. This suggests that principals are indeed an appropriate locus for school- 
level instructional policy decisions, at least in our 20 schools. 

As we discuss below, there are no fixed programs or single strategies that can 
raise reading scores all at once. But it does appear that reading instruction can be 
improved on a school-by-school and classroom-by-classroom basis when individual 
programs are carefully planned, adapted to local circumstances, and implemented 
effectively. 
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Factors AfTecting Reading Achievement for Black Children 

On the basis of our analysis we conclude that tlvve broad cafe/^ones of factors 
produce improved readinf^ achievement for Black children: program content, im- 
piementation strate^iea] and classroom atmosphere. These relationships were strong, 
and remained consistent even when we rvxcluded tc-isi scores for classrooms where 
there was strong evidence of prior test exposure. When we further excluded test 
scores for additional classrooms showing unusuail y large gains, some of the associa- 
tions we report here became weaker. Confidence in the soundness of our results must 
therefore be tempered by the reader s judgment about how much test exposure 
actually occurred. We believe that the middle-ground position we used in generating 
the results we report here is at least reasonable. 

We found that readin<^ achievement improved when the readin^^. program used 
varied material for different students at the same time. Other more novel ap- 
proaches to instruction,^such as open classrooms and team teaching, were not consis- 
tently related to measured gains on standardized reading tests. Our analysis of other 
program content measures also supported the conclusion that reading curricula do 
not, by themselves, determine the success or failure of a school^s raiding program. In 
fact, there is wide variation in average student progress among classrooms that have 
very similar curricula and reading strategies. This may imply that any of the 
reading programs we studied can be effective depending on how well it is implement- 
ed and taught. Principals may wish to consider whether an eflective program of' 
individualization — such as the one measured, by our ''use of varied materials" ques- 

• ^ tion — can be appropriately used in the'ir schools, as well as the question of how such 
a program could be implemented. Additional teacher training, and visits by resource 
staff to individual classrooms to observe and suggest activities that will strengthen 
teachers' use of individualized techniques, may be<=useful in pursuing this goal. 

We :0und that program -implementation affects reading achievement across a 
range of instructional methods and school settings. The implementation strategies 
chosen by a school to support its reading program are crucial, because how a reading 
program is carried out strongly affects how much students" learn. The importance 

. of implementation^fetrategies is very great even after takiilg intu account the impact 
of curriculum, classroom setting, and teacher attributes. Successful implementation 
strategies in our sample included adequate teacher training (especially with respect 
to the use of varied materials), a high level of informal consultation among staff, and 
freedom on the part of teachers to make modifications in the reading program that 
increase its pertinence to the practical situations they encounter in/their class- 
roomsr-In-generah^lTe more-active was the role of teachers in implementing the 
reading program, the more reading achiev4?m"ent improved. 

Classroom atmosphere factors that affected reading included an absence of dis- 
ruption, frequent contocf between teachers and parents, and a feeling of efficacy on 
the part of teachers. Our measurements of the cla.ssroom setting are not subtle, but 
they confirm the hypothesis that the background for learning can affect teachers' 
and students' productivity. Moreover, we found that teachers matter for reading: 
their sense of being able to "get through" to students, their commitment and morale, 
help to determine how much children learn. We were surprised to find little br no 
association between teachers* background attributes and reading progress in their 
classrooms. Years of experience, ethnicity, college major, or place where the under-- 
graduate degree was obtained appeared to have little influence. 
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Policies that strengthen teachers' commitment and provide them with the skills 
and resources necessary for them to perform well in diliicuU circumstances may 
contribute to improved classroom settings, and thus lo improved reading achievp- 
ment, ^' 

As an iH'-i.-^trcition of the qiuintitaiive importance of^the varioui^ spcci/ic /acfors 
that we hare identified os important, we estimate that exposiui^ the average i^iudent 
in our sample to all of the approacnes found to be effective would have retiuKed i/i 
a lO'to 20 point percentile f^ain for that student over the course of ihe~6th f^rade. 
instead of the decline of 3 percentile points that actually occurred. 

As we stated earlier, our analy-^is demonstrated that principals' ass.essments of 
teachers accurately predict how much st^udents will gain in reading. While it is 
likely that parents and teachers als(j4^ve valuable information about scKool prob- 
lems, the principal has a i3?.i{|ue opportunity to observe the whole situation at his 
or her school A^nd to act i ; ..nprove it. Principals can exercise their leadership in 
a number of ways that may help produce reading gains, by observing teachers and 
making specific recommendations for change. Principals can fa?ilitc'ite bucce.ssful 
program implementation by working to provide adequate training for teachers, and 
they can encourage teachers to consult with each other and to modify their pro- 
grams to meet their students' needs more fully. 

For the predominantly Black schools in our sample, high levels of parent and 
community involvement appeared to be associated with better reading outcomes. 
Although our study of this relationship was constrained by resource limitations, and 
althoiigh no similar finding was derived for Mexican American schools, we suggest 
that the current district policy is sound in encouraging schools to involve the com- 
munity in the educational process. 

In summing up our substantive findings, it is important to emphasize that no 
sinf^le school or classroom factor, taken by itself is likely to produce large increases 
in reading achievement. We found many school and classroom factors that were 
strongly related to reading performance, but no one factor or small group of factors 
dominated our findings. We believe this is to be expected. Reading instruction is far. 
too complex to allow for simple policies or "quick fixes/' 

Our findmgs suggest that continuation of the district's policy of school-level 
goal-setting for reading, and delegation of authority to schools and teachers to make 
program planning and implementation decisions, is appropriate for the sample of 
selected schools. 



APPLICABILITY OF THE FINDINGS TO OTHER SCHOOLS 
AND FUTURE POLICIl^ 

In considering the degree to which our findings may be applicable to other 
educational settings, we must repeat the caveats we have stressed in this report: we 
worked with a ndnrandom sample of predominantly Black and Mexican American 
schools in Los Angeles, and studied intensively only what occurred in the 6th grade 
in those schools. Consequently, generalizations to other minority schools, to 
predominantly Anglo schools, to other districts, and to other grade levels can be only 
suggestive. 

With those caveats in mind, we offer the following policies as general guidelines: 
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' • Because our analysis illuminated the importance of particular schools and 
classrooms within schools (or reading progress, a good measure of local 
school autonomy seems warranted, particularly in large districts. This 
suggestion is bolstered by the conformity of our results to previous research 
in the field and by our finding that principals we queried have accurate 
knowledge of their teachers' relative effectiveness in the classroom. 

• Though the specific factors we identified as efficacious were associated only 
with reading gains for Black students, they tod are confirmed by other 
research on both majority and minority schools. Teacher flexibility, in- 
dividualized approaches, teacher-to-teacher consultation, training and 
morale enhancement for teachers, and involvement o(' parents and com- 
munity members in the educational process all appear to have payoffs — 
and all point again toward the desirability of school-level decisionmaking. 

• Therefore, the national trend we observe toward central direct ion in school 
districts may not be very prodi^ctive, at least for large, complex school 
systems. 

To the extent permitted by local resources, school district research staffshould 
attempt to replicate and extendthe findings of this limited study, and should pursue 
issues that we were unable to resolve adequately. These include: the utility of* 
standardized tests for gauging reading achievement, the relevance of national norm 
criteria to minority children, the consequences of the growing emphasis on test 
scores as measures of success, and the factors associated with true reading achieve- 
ment for students from non-English-speaking backgrounds. Further research of this 
kind is likely to p|rovide useful information for policy decisions. 
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Appendix A 
SAMPLE DESIGN AND DATA COLLECTION 



This app^fndix describes various technical aspects of the study performed. We 
first outline the procedures used to select the elementary schools included in our 
sample. We then discuss how we traced students from the 6th grade classes of 1974 
and 197.5 to thie junior high schools they attended in February and March 1976 
where their cumulative records were lodged, and the extent to,which the sample of 
students for whom data were obtained are representative of the population of 6th 
grade students in the selected elementary schools. We, also describe the methods we 
used to collect data on school and cFassroom factors. ' 



SELECTION OF THE SAMPLE ELEMENTARY SCHOOLS 
Criteria Used 

The criteria used in selecting the 20 sa'.nple schools ^ere that each school should 
demonstrate substantial or consistent test score gains, a predominantly minority 
enrollment, and enough 6th grade classrooms to exhibit variation in reading ap- 
proach, and that each should serve a population that is low in socioeconomic status. 

The LAUSD's Request for Proposal criteria for the sample schools were that 
each should have a predominantly minority enrollment and substantial and consis- 
tent test score gains on the 6th grade reading test. These criteria relate to the 
purpose of the study, which was to identify those elements of the reading program 
that improved reading achievenient in minority schools. 

To further define an appropriate population. Rand added two mor^ riteria. 
Some schools are extremely small (for example, Solano); with only one or two class- 
rooms at each grade level; the school-size criterion was formulated to ensure a 
sufficient sample of students from each school so that we could measure variation 
in school-determined aspects of the reading program. In addition, a few predomi- 
nantly minority schools serve populations of relatively high socioeconomic status 
(for example, Windsor Hills). Because children there were expected to outperform 
minority children elsewhere, we added a criterion for socioeconomic status. 

To_quaatify_these criteria, we used the following definitions: 

Substantial Gains: An increase in the 6th grade class total reading test score 
median (national norm percentile for the school ) of 15 or more percentile points from 
Fall 1972 to Spring 1975. Schools with substantial gains were not required to have 
consisTent gains. 

Consistent Gains: No gain in any one intermediate year greater than two-thirds 
of the total gain. Fall 1972 to- Spring 1975. 

Minority Enrollment: At least 60 percent nonwhite enrollment. Fall 1972, and 
at least 80 percent nonwhite enrollment. Fall 1974. (Nonwhite enrollment includes 
Black, Mexican American, Native American, Asian American, Filipino, and other.) 
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No school was to be selected that derived more than one-half its minority enrollment 
from the Asian American population. (This limitation was included because Asian 
Americans normally have hi^jher achievement levelsj 
School Size: Enrollment of at least 400. 

Socioecommic Statua: Title I rank of 200 or lower. Of the ristrict s 436 elemen- 
tary schools, ranks 1 to. 200 represent the *'most disadvantage "' schools. The Title 
I rank is based on AFDC (Aid to Families with Dependent Children), free lunch 
program participation, the distribution of family income in the 1970 Census of 
Population, and the distribution of assessed values for single-family residential 
properties. \ ' 

, To select the schools, we first identified the 200 that qualified on the basis of 
socioeconomic status. We then reduced this list by the school-size and minority 
enrollment criteria, wii left 87 schools for consideration. The test-score changes 
(5th grade to 6th grade ; e examined for all of these schools, and the 8 schools with 
substantial gains (15 or more percentile points) were selected for the sample. .(These 
schools did not necessarily have consistent test score changes.) We also identified 19 
schools that registered consistent test-score changes, and divided, them into two 
groups: those with less than a 10 percentile point gain and those with gains of 
between 10 and 14 percentile points. We selected 6 schools from each group, so as 
to maintain a balance in the sample between predominantly Black and predomi- 
■ lantly Mexican American schools. Table A.l presents the sample schools and their 
values on each of the selecti/n criteria.. 

Comparison of the Sample Schools with All LAUSD Scr.ools 

In comparison with all LAUSD schools, the-20 sample schools have a higher 
percentage of minority students, larger size, lower .socioeconomic status, and larger 
gains on 6th grade reading test scores. (See Table A.2.) 

Although the sample schools were constrained by study objectives to have at^ 
least 80 percent minority enrollment, the ratio between Black and Mexican Ameri- 
can-students in the sample is the same as their ratio in the district. Asian American 
and Native American students, however, are not represented in the sample in 
proportion to their ethnic distribution in the school di,strict. The two schools with 
the highest proportions of Asian Americans were excluded from the sample. Caste- 
lar was excluded because its enrollment was more than 50 percent Asian American; 
Col iseuni Street, which has an Asian American enrollment of 46 percent, was ex- 
cluded l>ccau.se its Title I rank was greater than 200.The twoscFrools with the largest 
shares of Native Americans (Park and Woodlawn) have more than 20 percent non- 
minority enrollments. 

Because the sample schools had to have at least 400 students, they are 70 percent 
larger on average than other district schools. There were 146 schools in the district 
smaller than the smallest school (enrollment of 591) in the sample. 

The district-wide gain in median national norrn percentiles on the reading test 
for 6th grade between 1972 and 1975 was 5 percentile points, or 15 percent of the 
base-year score. The sample schools, which h . considerably lower mean score in 
1972, had increased their scores during the period of the study to the extent that 
their mean score was closer to the district median by 1975. 

Sample schools were lower in socioeconomic status than the mean for the dis- 
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Table A.2 



Comparison of Sample Schools with All LAUSD Schools 



Characteristic 


All Schools 


Sample Schools 


AFDC Rank, 1971 




^. 


Hankie 


1-4 30 


11-159 


Mean 


218 


75 


Ethnic Di.stril)ution, 






Fall 197-1 (%) 






Black 


24.8 


41,7 


Moxican American 


3 1 ,8 


53, 1 


Asian American 


4.9 


2.7 


Native American 


0.3 


o!i 


• Other 


38.2 


2.4 


Hoadin^i test scori'S, 






CTBS-Q2, Grade G^' 






1972 


33 


15 


1973 


33 


18 


1971 


38 


22 


1975 


38 


31 


Gain. 1972-75 


5 


16 


Enrollment, fall 197-1 






Ran^ie 


1 16- 164 1 


591-1462 


Moan 


736 


1030 



''Median national norm percontile for the district, mean of tin* N 
median national norm percentiles Tor the sample schools. A med- 
ian is published for the entire district and for each school for each 
year. Without the raw data, it is impossible to const rue t^nedi a ns 
for ^iroups of schools; therefore, the mean of the medians for the 
sampl(> schooLs is us(>d. 



trict. This means that the typical sample school had a Title I rank closer to the most 
"disadvantaged" and lowest in socioeconomic status than that of the typical school 
in the district. 

Comparison with Minority Schools in the LAUSD 

The 20 schools had lower median national norm percentile reading test scores 
in 1972 than the average school with at least 80 percent minority enrollment. They 
also had greater gains than the average minority schools, and in 1975 had higher 
test scores. (See Table A.3.) During this period the 80-percent-minority schools had 
gains in median national norm percentiles higher than the district's gain for all 
students. 

The sample schools were larger on the average than the typical minority school 
in the district,. and had slightly more Mexican American and fewer Black, Asian, 
and other t tluiic students enrolled than the average minority school. The sample 
schools had a .lightly lower Title I rank than . the average minority school in the 
district. This means that sample schools were slightly lower in socioeconomic status 
than the average minority school. 
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/ . :. -Table A.3 

' Comparison of Sample Schools with All 
80-Percent Minority Schools in the LAUSD 



Characteristic 



All 80-Pcrcent 
Minority Schools 



AFDC Rank ( 1-97 I) 



SanipU' Schools 



Rtin^t' 




1 11.1 


Mca n 


' 1 (\0 

j I VJU 


7''» 


Ethnic Distribution, 






Fj)I1 1974 (%) 




J 


Black 


50.7 




Mexican American 


41.9 


53.1 


Asian American 


3.9 


2.7 


Native Amoricun 


0.1 


o.a 


Other 


3.4 


2/4 

/ 


Reaciinjj Test Scores, 




(■ 


CTBS-Q2, Grade 6" 






1972 


IS 


15. 


.1973 


19 


18 


1974 


23 


22 


1975 


28 


,'31 


Gain, 1972-1975 


10 




Enrollment, Fall 1974 




I 


Rnnjie 


146-1641 


591-1462 


Mean 


851 


1030 



'Mean C)rscho{)l median national norm percen 



ile. A median is 



puhlisliod each year foir the district as a whole anc for each school 
in the district. Without the raw data, it is impossible to contract 
medians for fjroups of schools; therefore, the meah of the school 
medians is used. 



DATA COLLECTION 



Student Cumulative Records 

To collect' historical data on the 1974 and 1975 graduated of the 20 schools, it' 
was necessc|ry to locate their elementary cumulative record folViers at the students' 
current junior high schools. At the completion of 6th grade, the elementary schooil 
records are keni to the junior high school where the student is expected to enroll the 
following ye^r. If the student does not, tl j records may be returlaed to the elemeii- 
tary school, or sent to another junior hish school that requests the records, or filed 
in an inactive file. Records are sent to other California school districts when request- 
ed by th(j receiving schools for trariferrmg students. \ 

To identify the junior high schools that the graduates of our 20 schools would 
be expected to attend, we used the Contributing Schools Report (prepared each 'fall 
by the Maps and Boundaries Section, Educational Housing Branch, School Building 
Planning Division) and the Permits with Transportation (PWT) Statistical Informa- 
tion Report(prepared by the Permits with Transportation Ofiice). The Contributing 
Schools Report identifies the elementaf-y schools that contribute to each junior high 
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school. The junior hij^'; .schojjs identified as receiving schools for our 20 schools are 
listed in Table A.4. Most of these schools are sending schools in the Permits with 
Transportation Prograni (PWT); that is. some of their students are transferred to 
other junior high schools. (Table A.5 is a libt of the receiving PWT junior high schools 
for each sending junior high school'in Table A.4.)The Permits with Transportation 
Program was designed to relieve rrowding ir inner city schools and to meet earth- 
quake safety standards by transferring students by bus to less crowded, new schools. 

The junior high schools- listed in the Contributing Schools Report were reviewed 
to ensure that a substantial proportion of each graduating class could be expected 
to be found. After data collection activities were conducted at each .junior high 
school, the number of records found from each elementary school was compared 
with the number expected. If the number of records found was significantly less than 
expected, the PWT schools for that junior high school were checked and added to 
.the data collection schedule if the school had enrolled a i-easonable number of 
students from the elementary school in question. This process continued throughout 
the "period of data collection activity to ensure that an adequate number of cases 
from each school were located. Table A.6 lists 6th grade sizes and numbers of cases 
for thr 20 s iple schools. . , . 

We ideuLilied 37 receiving junior high schools where graduates of the 20 sample 
schools were expected to matriculate. We collected data at 32 of these schools, 



Table A.4 

Rfxeiving Junior Hioh Schools for 
Sample Elemental' Schooi^ 



Sc-Ii()(j1 .N'jinic 


School .M;ime 


.Adjitiis 


■'mhes^'-^' 


.•\U(luh()Tl 




Belvedere 


Maclay 


FJiTendo 


.Majiji 


Bethune 


.Markliani 


Bitrl)ank'' 


.Mount Vertion 


Biin-nuulis ' 


Muir 


C!;i rver 


.Vi^lil inhale 




Nohel^'- ^' 


Drew 


I'acoijiia 


lulisoii 


I*asli'ur 


Kl Sereno 


I'orlola*' 


l'*()sh;i V 


lieveret' 


Kiillon''-^' 


San Kerjiatulo 


Cauet' 


Sepidveda**-'' 


Cioinpers 


Slevensoji 


CrilTilh 


Virgil , 


Ihirte 


Wehste/' 


I lolletdH'ck 




'*Reeeivinu junior lii^li solioo). class o!" 197') 
only. 

Ileeeivitm junioi- hi^h scho(d, class of ID? 1 
only. 

^ Nol 'ending school in the PW'I' ))ro^ran!. 

'^Both sending and rect»iviim >chool in \'\\"V 
prourani. 
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Table A,5 

'Permits with Transportation" Junior High Schools, 1975 



School 



School 



No, oT 
Pupils 



School 



School 



No, of 
Pupils 



Adams 


Kulloii 


1 




Uolnifs 


2 






2 


vXuduhon • 


Bancroft 


2 




Columbus 






Bmcrso n 


.10 




1 1 (Ml ry 


:\ 




Holmes 


:i 




llii^lhcs 


2 




Madison 


'5 




iMilllkan 


•) 




Nobfl 


f) 




Palms 


:5 






so 




Sutter 




iJcl v(m1(M'(* 


I Ol • Ol d 




BcriMido 


Bancroft 


1 




Holmes 






I lutjhes 


1 




Reed 


115 




Se({uoia 


1 1 


Brthum* 


Hnierson 


2 




Kulton 


(i 




Holmes 


•) 




Hut;h es 


1 




Madison 


:i 




Nohel 


2 




Parkman 


1 




Se j)ul veda 


1 1 

1 '» 




Sequoia 


() 


Burhank 


Miilikan 


2 


Burrou^ihs 


Bancroft 


1 




KnuM'son 


2 




Madison 


1 




Palms 


o 




Uev(»re 


1 


Cixrwr 


Bancroft 


1() 




Columbus 


1 




ICmerson 


12 




Kulton 


•J 




1 1(»nry 


1 




Madison 


:\ 




Revere 


129 




S(»pulvt»da 


i:^ 


Clay 


(.'arneyie 


M 




V'mers()n 


1 




l'*h'mintJ 


2 



Drew 



Kdison 



Kl Sereno- 
Foshav 



Cionii)ers 



C;riffith 



Fulton 


1 


Holm es 


•) 


1 1 ui^hes 


If) 


\ 1 ' 1 f 1 1 CI 1 tl 


s 


\If 1 1'i It ri f li'f> 




I <li nlildll 


() 


Porter 




R evert* ' • 


'2 


Sepulveda 


[1 


S;'(iuoia 


ll 


Sutter 


'l 


Van Nuys 


•J 
ll 


White 


•I 


Wri^jht 


;? 


Madison 


f) 


Mulholland 


1 


i^irkman 


.s 


Revere 


•) 


Bancroft 


f) 


Kmerson 


9 


Madison 


7 


Miilikan 


1 


Mulholland 


1 


Parkman 


1 


Revere 


f) 


Millikaii^ 


:i 


Portola ^ 


21 


C'arn(?t:ie 


7 


Columbus 


7 


Km erson 


9 


Henry 


[] 


H M 1 IT\ f >^ 


s 


1 Iut:hes 


1 


Machson 


1 


Miilikan 


2 


Nobel 


2 


North \'\i\u,v 


2 


Porter 




R everc 


2 


Sec)U(}ia 


7 


Dana 


s 


Kmerson 


2 


Klemint: 


15 


Madison 


1 


Revere 


() 


Sei)ul ved;.i 


1 


White 


M 


Portola 


70 
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Table A.5 (Continued) 



o c n u I n ^ 


Kccc I VI 


i\ o , 0 1 


Sendi nii 


» 

Ixeceivi u\l 


No. ol 


School 


School 


Pupils 


School 


School 


Pupils 


Hartc 


Carn'o^ML* 
P^lcming 


17 
17 




Carnegie 
Kmerson 


2 
22 




Fulton 


109 




Frost 


39 




Holmes 


5 




Henry 


4() 




I 1 ll^IlL'b 


.1 
•1 




Ho Imcs 


.1 
•1 




ivl '> f \ 1 ^ifl ti 

IVl (4U lasJ 1 1 


1 1 
1 •* 




\ l '1^1 1 cf 1 n 

1> 1 til J lovl 1 1 


1 




Mulholland 


■ SI 




MiHikan 


21. 




IN Ol mi L* 






Nohcl 


. ] 




Pa rkman 






Palms 


20 




Rccd 


1 
1 




Porte r 


3 




RCVLTO 


l 




Keed 


4 




Scpulvoda 


99 ■ 




Revere 


33 




StHjuoia 


-13 




Se({Uoia 


1 




Van Nuys 
White 


•16 
'iS 


Muir 


Bancroft 
Kmerson 
Henry 


1 

15 
1 




Wright 


9 




ilolIonlK'ck 


Portola 


() 




I lolmes 


12 




Millikan 


17 




1 1 u^he.s 


1 






Le (Jonte 


In 


MilClil\' 


I Ol l() 1 (1 


1 
1 




Madison 


1 ri 
1 () 




'I it \I 1 » \ * c 








«) 


Mann 








Nobel 


2 


Carnegie 
Emerson 


1 

21 




Palms 


1 




Kulton 


. 1 




Reed 


1 . 




lionry 
Holmes 


1 




Revere 


•) 




121 




Sepulveda 


;j 




Hughes 


131 




Sutter 


1 




Mad iso n 






Van Nuys 


5 




iVX I I ] 1 K d n 


1 

1 




Wright 


1 




\i 1 1 1 Ii ( 1 1 1 't 11 f i 

ITl LI 1 1 1 1 1 (1 1 1 I 1 


\ 


Nightingale 


Millikan 


14 




Nobel 


117 










- 


Pacoima 


Portola 


I 




I (.11 IVIlldll 


2 


Pasteur 


Bancroft 


2() 




Porter 


1 




(>arne^ie 
{'olumbus 






Keverc 


29 




1 
1 




Sepul veda 


2 




ivnerscin- 

Henry 

Palms 


*) ') 




Secjuola 


3 




f) 




Sutter 


104 • 




IMS 




Wri^Mit 


24 




Porter 


K 


Mark ham 


Carnegie 






Itevere 


3(5 




Emerson 


■i( 




Sepulveda 


2 




Fleming 




San \'ernand<) 


Portola 


1 




Fulton 










Holmes 


2 - 


Stevenson 


Portola 


4 




Mulht)llan(l 


2 


Virgil 


!':vMikan 






Revere 




121 




' White 


1 




Re-'d 


2 


Ml. Vernon 


Bancroft 


' 1 


Webster 


Palms 


2 



I 



o 

ERIC 
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Table A.6 



Size of 6th Grade by School and Cases in Study, 
Classes of 1974 and 1975 



• 




1 974 






1975 






Size of 




% of 


Size of 




% of 


School 


Gth Grade 


Ca.ses 


Class 


6th Grade 


Cases 


Class 


Alta Lonia 


1 O r: 
1 Zi) 


O ^ 




1 1 U 


on 


o u 


Angclos Mcsij 


1 S. O 


1 {\ 1 


OO 


1 1 / 


oy 


/ 1) 


Ascot AvcMiuo 


1 1 1 


y u 




1 U J 


yo 


J VJ 


Uacotah istroct 


1 1 

1 1 <i 


oU 


/ 1 


yo 


t u 


7 ^ 


Eastman Avenue 


1 / O 


1 1 fi 
1 '1 o 


Si. Q 


1 T 1 
1 / 1 


1 0 J 


O J 


Ford Boulevard 


1 Q 
1 0<) 


1 no 


T 1 
/ 1 


no 
y y 


/ Ji 


7n 


Harrison 


vS6 


66 


7 7 


7.1 


65 


88 


Hillside 


72 


58 


80 


77 


61 


• 79 


Manhat tan Plaeo 


M8 


92 


B2 


1 6-1 


1 19 


72 


McKinley Avenue 


1 lo 


95 


83 


106 


72 


68 


Miller 


153 


1 13 


7 1 


1 11 


88 


77 


' 1 18th Street 


93 


60 


6 1 


90 


71 


• 79 


1 r2th Street 


109 


76 


70 


89 


71 


80 


Paeoima 


189 


121 


6-r 


183 


15.1 


84 


. Rosemont Avenue 


Ml 


88 . 


61 


1 21 


103 


. 85 


Rowan Avenue 


162 


1 16 


90 ' 


179 


146 


82 


Sierra Park 


iri7 


HI 


90 


163 


115 


89 


10th Street 




' 1 16 


79 


138 


125 


90 


28 th Street 


133 


93 


70" 


122 


95 


78 


Vermont Avenue 


126 


.110 


87 


1 2.1 


102 


82 ■ 


Total 


26fiG 


2666 


7-4 


2.1.12 


1990 


81 



including 4 that received students in the PWT program. The aim was to find records 
for at least 80 percent of each graduating class. Initially, 27 schools were scheduled 
for data collection; 5 more were scheduled to increase the proportion of records 
found from the 20 sample schools. Table A.7 describes the kinds of information 
collected in the 20 schools; Table A.8 and A.9 present the number of records located 
at the junior high schools for the Classes of 1974 and 1975. 

The data items recorded on prepared coding forms from the cumulative record 
files located in the junior high schools were: 

• Elementary school attended 

• Student's name (for coding verification; student identirication by name has 
not been retained in our data files) 

• Sex , 

. Ethnic background (as determined from name, birthplace, parent s photo, 

and language spoken in the home) 
. Presence of parents in the home (from \\6i\ng of guardians, step-parents, 
comparison of student's and parents' names and person responsible). 

• Parents' occupations 

• 1st grade reading test'score (Cooperative Primary) (Class of 1975 only) 
.• 3d grade reading test score (Stanford or Cooperative Primary) 

• 4th grade Spring reading test score (CTBS-Q2 or R2) 
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Table A.7 



'Descriptions of Data Collected in the 20 Elementary Schools 



Information 


Source of Information 


Examples 


School DaUi Sheet 


Principal /Office Mana^ier 


Enrollment, turnover, specialists, 
aides 


Principal interview 


Principal 


Activiti(?s to sui)i)orl pru^M-am im- 
plementation; teacher reactions to 
pro^M'am; community involvernent ; 
reasons for reading* jj;ains; problems 
encountered in implementation 


Principal asse ssm e n t 

r»r li^'if'li <»r cL'ills: 

\J I 11.111,111.1 ^l\llio 


Principal 


Use of mana^^ement system; combining* 
teaching ol skills and comprehension; 
'maintaining reasonable discipline 


Readintj Coordinator 
interview 


Readin^^ Coordinator 
or equivalent 


Components of reading* pro^M'am; 
successful instructional technitiues; 
community involvement; problems 
encountered in implementation 


TeachtM* C|iiestionnairc 


(Sth ^nade teachers, 
197.1-7-) 


Methods of reading* instruction; 
emphasis on test-taking* skills; 
training* received; resources, 
aides, parent involvement ; sui)i)ort 
from staff, si)ecialists, princiiial; 
problems encountered; results of 
reading* pro^^ram 


Checklist for 6th ^M'atlers 


6th ^M'atle teachers. - " 
197-1-75 


Special serviees received; l^arent 
cf>ntact; motivat ion • ^ 



• 5th grade Spring reading test score (CTBS-Q2 or R2) 

• 6th grade Spring reading test score (CTBS-Q2) 

• 6th grade Spring math test score (CTBS-Q2) (Class of 1975 only) 

• 6th grade Spring reading test score (CTBS-S2) (Class of 1975 only) 

• ' Date'of continuous enrollment in sample school 

• 6th grade teacher's name ' 

• Days absent^ 4th, 5th,' and 6th grades ' • 

• Names of, two 6th gradeVeading textbooks (Class of 1975 only < 

• Number of reading textbooks listed (Class of 1975 only) 

Information on the junior high school cumulative record folders was used only 
where photograp'o were needed for ethnic identification or for clarification of infor- 
mation on the lementary folder. 

Two teams of specially trained coders recorded the information. They worked 
at the junior high schools under arrangements made with the principal, head coun- 
selor, and ere 'it jlerk. The . .-'crs senx jhod the 7th and 8th grade files for records 
of graduates of any one of ^he 20 schojL-;. Because thejanior high schools organize 
their cumulative record files in various ways, the te^uits checked any'^Special files 
(Title I, Mental!; Gifted Mi nors, Englii h as a Second L^inguage, Educable Mentally 
Retarded) and inactive files so u.- to locatr all types of students from each of the^* 
sample schools. 
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Test scoVe data'fbr the Class of* 1975 from theLsamf>k'-s^ools^-i::e4vl^a-obtained 
for 4th, 5th,\and 6th grades using conxputer-printed test scores for students by 
school. To acquire information on the 6th grade test results for each school, and to 
compute changes for each school, it was.^ necessary to do a haad match of the comput- 
er record.s^vvith\the information coded from the cumylative records. (Test scores for 
each gi*ade wer^ not on the cumulative record files for each year Ibr each school.) 
For grades'^ anld 5. these printouts were obtained from the Title 1 Research and 
Evaluation and fbr grade 6 from the Research -and Evaluation Office t)f the 

District. Thesei prmtouts were matched by name and birthdate to information col- 
lected on the cumulative record coding'fbrm. The name was not included in any 
computerized records created at Rand, so this matching was carried oui by clerks 
on the individual records. Added to the basic data records were 540 grade 4 scores, 
399 grad-e 5 scores, e^nd 205 grade 6 scores. 

Representativeness ^pf the Sample 

To ascertain whetl^er the sample of students for whom we found cumulative 
records i^ represeiitativfe of all students who took the 6th grade reading test (CTBS- 
Q2), wc made a compaffson of test results for the graduating Class of 1975. This 
comparison was m,dde possible by hand-matcjilng the 6th grade computer printout 
of the CTBS-Q2 re$;ults tA the data recorded from the cumulative record folders, to 
ensure there was complete information on the 6th grade scores. 

The sample of the Cla$s of 1975 included 76 percent of all test-takers in the 20 
schools. The mean raw scoVe on the CTBS-Q2 was 54 for both the ...Miiple and all 
test-takers. At the school level, nine of the schools had exactj^ the sai^e mean raw 
score in the sample and for all test-takers. Iil eight schools the difference v/as only 
1 between the mean raw scpres of the sample and all testHakers. In two schools 
iDacotah Street and Pacoimtl) the difference in mean raw scores was 2, and in one ^/ 
school (118th' Street) the difference was 3. Thus we have strong evidence that the 
_students for whom j| was possible to build longitudinal records of test-score results 
constituted a representative st^mple of all test-takers in the student population. 

Collection of Data on School and Classroom Factors 

We conducted two kinds of sludjes in our 20 schools. We wanted, first, to get a 
full picture of how reading programs fit into the larger world of the school. Second, 
v/e wanted to conduct a comprehensive survey of reading instruction at each of the 
schools. We began by studying three schools in detail, to ascertain the kinds of 
differences among reading programs that should merit our attention in all of the 
sample schools. We also tried to discover how schools'act as the i^ctlin^ for a reading 
program — for example, how special prognnns such as Title I affect reading, how a 
new math curriculum might consume more teacher time and therefbre aflect read- 
ing, or how the school's planning and problem-solving procedures are applied to the 
reading program. We accomplished this b.v rn^^ans of personal interviews with school 
people. 

The other phase of our work in the 20 schools largely consisted of theadministra- 
tion of a series of questionnaires. Using the iniormation and understanding we 
gained in the three detailed studies, we constructed a group of interview forms and 
questionnaires to enable us to gather quantifiable information that would be compa- 
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rable across all the schools in our sample. We interviewed several staff members at 
Bach school, because we believe that people with different roles in the reading 
program— teachers as compared with principals, for instance— have different in- 
sights into how it worked. ^ , 

We received remarkably fuU cooperation from the administration, staff, and 
faculty of all 20 schools. All principals and all reading coordinators agreed to be 
interviewed or completed questionnaires. Of the 83 teachers who were responsible 
for 6th grade classes in 1974 and 1^75, 81 completed questionnaires, even though 
many were teaching in other schools by the time we traced them, and one was 
teaching in another state. Our access to school personnel and records was consis- 
tently facilitated. 
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\ Appendpc B 

SIXTH GRADE READING ACHIEVEMENT AS A FUNCTION 
OF INITIAL ACHIEVEMENT AND BACKGROUND 



Black 



Mexican 
American 



Vai'iai)le 



Fiflh.^radc set) re 
Malo 

*• Day.s.ai)si'nt ' 

Health faclors cited 

a ni i I y : m u t h e r , fa t li e r 
mother only 
^'uartfians 

K a I h e r : p ro fess i o n a 1 . 1 e c h ii i c a J 
while colhii" ^ ' 
craft worker 
iy)erative . t ^ 
lai)orer 

service worker 
^ ocgu^)atioyrf l)lank • 

Mother: while collar 

service worker 
^ operative 
hoyscwit'e 
occupation l)lank 

A\fv in months 

Keniedial reading' pullout 

Oiftcd pro^'ram pullout 

Constant 



Children 


Uiif^lren 


.7 1 { lo,,T2.) 


■.7r(21.90) 


( 


, .rii) 




i,r)6) 


-.19 ( 


2.9S) 


• .03 { 


.91 ) 


2.98 ( 


i.sro 


' -,52 ( 






.IS) . 


- U65 ( 


.sn' 


.1:3 ( 


.11) 






:-2.S7 ( 


.6S) 


.26 ( 




^■■-5.7S ( • 


i.:iS) " 




1.39), 




LK07) 


.32 (' 


. 1 ('))'• 


-l.-l 1 ('• 


1.26) 


.66 ( 


.35) 


. -T l6.2(i ( 


2.91) 


.02 ( . 


.01) 


-'(5.69 (■ 


2.12) 


l.jr)( 


.73) 


-5.S-1 (- 


1.7S) 


.33 ( 


.in 


-l.S.i 


l.b7) 


.33 { 


.IS) ■ 


-2.^10 ( 


-.61) ■ 


3. On ( 


.90) 


-1.2-7 ( 


1.1:0 


1.92 ( 


.6'6) 


1.06 ( 


.10) 


• 3.7-1 {. 


1.5S) 


-1.06 ( 


.:J3) 


-.1 1 ( 


.2f) 


. -.5.S{ 


•.IS) 


-1.60 ( 


-.73) 


-.;u ( 


2.2J) 


■ .16 (- 


l.,79)^ 


• 10.21 (- 


•r..-M) 


' 3.13 ( 


l.Sfi) 










2.0s (■ 


.riS) 


1.61 


1.03) 


S 1 . 1 3 ( 


3:?i 1 ) 


. ri().33 ( 


3.62) " 



Number of observations 



.581 
356 



.675 



NOTKS: Entries arc r^^ression coen'iHents. with t-statistics in parentheses. 

Excludes ol)servations obtained from classrooms in which test exposure was 
reported or indicated by field research. . - 

Pocause of tht; varying! t|Liality of sonic of the background data, and because 
of the substantial niulticollinearity in the sample^ it is' unwise to interpret,the 
Tiize and direction of individual coefficients. These re^'^ression ^(pintions are 
simply designed to control for as much of the pre-6th-^rade background of each 
child as possible; no further inference is intended. 
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Appendix C i 

VARIABLES IN REGRESSION ANALYSIS OF READING 
ACHIEVEMENT FOR BLACK CHILDREN 



I. BACKGROUND VARIABLES ^ 

6th GkADE SCORE. Raw score on CTBS-Q2, given May 1975. 
5th GRAD?^ SCORE. Haw score on CTBS-R2, given May 1974. 
Sf.x. Dumniy variable for male student. y 
Attkndanck. Days absent during 1974-75. 

Health problems. Dummy variable for whether any "significant health factors" 
were noted on child's record. 

Family status Dummy variables* for mother and father present; mother only 
present: gu-^.rdians present, from child's record. 

Fathkr s (AXUPATiON. Dummy variables for selected occupations: professional, tech- 
' nical, and kindred worker; white-collar worker; craft worker; operative; labor- 
er; service worker; father's occupation missing. 

Mothkr's occupation. Dummy variables for selected occupations: white-collar 
worker; operative; service worker; housewife; mother's occupation missing. 

Age. Age in months. 

Remedial reaThi^jo. Dummy variable for .vhether child was "pulled out'' of regular 
classroom for supplementary inctruction in reading by a teacher other than the 
regular tei^cher. 

Gh-ted program. Dummy variable for whether child was "pulled out" of the regular 
program to participate in special activities for gifted children. 

II. vCLASSROOM VARIABLES (REPRODUCED FROM THE 
TEAtJHE^ QUESTIONNAIRE) 

DiSRUiTiONs. In a typical month last year, how oflen did you have severe disruptions 
(fights, loud or boisterous play, vandalism) in your classroom? 

Novpr 1 

Once oi* twico 2 

:3— .0 tinu's 3 

10 timr.s 1 

Morc'than 10 limes 5 



Number of parent visits. About how many of your students' parents came into the 

classroom for a visit last year? 
Sense of p:fficacy. Product of: 

Please indicate whether you agree or disagree with each of the following 
statements about this district, this school, and about teaching. 
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NlMllUM- 

A^roo Nor 



WluMi it comes ri^lil tlown U) il, 
a leacluM- really can't do much— 
most of a sludcni's motivation 
and perTormancc doponds on liis 
or her liomo cnvironmcnl 

ir I iry really hard. I can ^el through 
lo even liie mosl dirficull or un- 
mot ivaleil si udenls 



Variety of mater^vls, with amount of training. Linear combination of: 

Please indicate the extent to which your school's reading program affected 
the following aspects of your teaching practices. 



Your use of a jirealer varii'ty of materials for dilTerenl children at any one lime 

7 6 n 1 . :? 2 r 
L_ I I I I I I 



(Ircal impact 



No inijiacl 



About how many hours of training sessions (lectures or workshops) did you 
attend before you began implementing the reading program in your class- 



room.'^ 



N( ne 1 

6 or fewer hours (consider G hours 

one work day) - 

7 to IS liours ( consider 18 liours 

three work days) '.I 

19 Lo 30 hours (considt.'r 'M) iiours 

one work week ) 1 

More than 30 hours T) 



Teacher ADAPrATiON of prooram. Product of: , 

To what extent were teachers encouraged to adapt or modify the reading 
program on an individual classroom basis? 



Ti> a ^*reat ex lent 



Not at al 
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Please indicate whether you agree, or disagree with each of the following 
statments about this district, this school, and about teaching. 



Stroiu'.lv 



A tcacluM's rr;u! ini: instrvicvions 
'was i'X|)i»c\<»<l li> (\>nr()rni c|i>si-(y 
to llu* sclioiW's loading f:)a)i:ram 
miidt'liiu's: making o\vt> 
tiKxliricat ii)n s in icadinii iitsl>*ur- 
lioM Was (iisci)ura^L'(l 



NlMtlUM' 

Disaiiicc 



Stn^^^ly 
Disayiiu' I)isai;r(>i' 



Tkachkk-to-tkachkk consultations. 

How much did you consult with other teachers on an informal basis about 
the reading program and your work with it? 



I ! I I I I ! 

A Uivat (Iral Not at al 



